-- Logs begin at Tue 2022-07-12 16:40:04 UTC, end at Tue 2022-07-12 18:02:06 UTC. -- Jul 12 17:29:44.121186 dv-cinder-848759-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 12 17:29:44.130331 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 12 17:29:44.132794 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 17:29:44 2022] *** Jul 12 17:29:44.132794 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 17:29:44.132794 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 17:29:44.132794 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: nodename: dv-cinder-848759-2-iscsi Jul 12 17:29:44.132794 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: machine: x86_64 Jul 12 17:29:44.132794 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: clock source: unix Jul 12 17:29:44.132794 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: pcre jit disabled Jul 12 17:29:44.132794 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: detected number of CPU cores: 4 Jul 12 17:29:44.132794 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: current working directory: / Jul 12 17:29:44.132794 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: detected binary path: /usr/bin/uwsgi-core Jul 12 17:29:44.132794 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: your processes number limit is 47680 Jul 12 17:29:44.133493 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: your memory page size is 4096 bytes Jul 12 17:29:44.133493 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: detected max file descriptor number: 2048 Jul 12 17:29:44.133493 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: lock engine: pthread robust mutexes Jul 12 17:29:44.133493 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: thunder lock: enabled Jul 12 17:29:44.133493 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 12 17:29:44.133493 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 17:29:44.177541 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: Python main interpreter initialized at 0x559fdc9fb9c0 Jul 12 17:29:44.177541 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: python threads support enabled Jul 12 17:29:44.177541 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: your server socket listen backlog is limited to 100 connections Jul 12 17:29:44.177541 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: your mercy for graceful operations on workers is 90 seconds Jul 12 17:29:44.177944 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 17:29:44.177944 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: *** Operational MODE: preforking *** Jul 12 17:29:44.178218 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: *** uWSGI is running in multiple interpreter mode *** Jul 12 17:29:44.178218 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: spawned uWSGI master process (pid: 103896) Jul 12 17:29:44.178452 dv-cinder-848759-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 12 17:29:44.180029 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: spawned uWSGI worker 1 (pid: 103897, cores: 1) Jul 12 17:29:44.180029 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: spawned uWSGI worker 2 (pid: 103898, cores: 1) Jul 12 17:29:44.180029 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 17:29:44.857923 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 17:29:44.858569 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 17:29:45.997021 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 17:29:45.997021 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: from cryptography.utils import int_from_bytes Jul 12 17:29:45.997651 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 17:29:45.997651 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: from cryptography.utils import int_from_bytes Jul 12 17:29:45.997850 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 17:29:45.997850 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: from cryptography.utils import int_from_bytes Jul 12 17:29:45.998356 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 17:29:45.998356 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: from cryptography.utils import int_from_bytes Jul 12 17:29:48.508989 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 17:29:48.509673 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 17:29:48.509767 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 17:29:48.510094 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 17:29:48.510509 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 17:29:48.510509 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 17:29:48.510685 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 17:29:48.510775 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.510914 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 17:29:48.511110 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.511279 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 17:29:48.511439 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.511536 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 17:29:48.511766 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.511911 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.512106 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.512238 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.512426 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.512558 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.512756 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.512857 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.513082 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.513186 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.513421 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.513516 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.513689 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.513785 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.514013 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.514108 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.514347 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848759-2-iscsi {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.514456 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.514697 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.514792 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.515012 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.515110 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.515337 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.515492 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848759-2-iscsi {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.515660 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.515766 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.515968 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.516074 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.516278 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.516389 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.516594 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.516683 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.516900 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.517113 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.517251 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.517522 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.517863 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.518024 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.518195 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.518349 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.518531 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.518656 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.518871 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.518974 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.519196 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.519297 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.519516 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.519615 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.519846 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.519937 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.520165 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.520270 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.520484 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.520578 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.520807 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.520897 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.521116 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.521213 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848759-2-iscsi {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.521510 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848759-2-iscsi {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.521610 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.521824 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.521918 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.522136 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.522237 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.522469 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.522574 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.522937 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.523053 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.523377 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.523488 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.523821 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.523927 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.524097 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.524193 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.524417 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.524513 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.524758 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.524846 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.525091 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.525186 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.525423 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.525521 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.525746 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.525833 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.526058 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.526152 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.526363 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.526474 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.526701 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.526803 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.527014 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.527111 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.527335 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.527445 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.527640 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.527737 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.527892 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.528006 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.528183 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.528282 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.528492 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.528582 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.528818 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.528991 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.529145 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.529233 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.529415 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.529509 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.529673 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.529764 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.529948 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.530035 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.530270 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.530358 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.530618 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.530722 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.530931 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.531031 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.531241 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.531342 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.531549 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.531649 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.531858 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.531946 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.532166 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.532262 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.532473 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.532567 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.532778 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.532876 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.533085 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.533181 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.533406 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.533495 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.533724 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.533819 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.534038 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.534133 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.534367 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.534485 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.534805 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.534894 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.535064 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.535204 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.535380 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.535467 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.535730 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.535822 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.536057 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.536146 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.536374 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.536473 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.536682 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.536784 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.537003 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.537092 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.537319 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.537458 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.537626 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.537763 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.537933 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.538040 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.538242 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.538330 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.538622 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.538790 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.539089 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.539269 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.539367 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.539584 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.539683 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.539840 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.539938 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.540146 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.540234 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.540454 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.540543 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.540777 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.540866 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.541088 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.541187 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.541395 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.541483 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.541702 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.541797 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.542006 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.542095 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.542313 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.542411 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.542643 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.542736 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.542950 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.543046 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.543258 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.543359 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.543564 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.543656 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.543873 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.543995 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.544183 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.544292 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.544486 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.544584 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.544791 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.544894 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.545111 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.545211 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.545422 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.545510 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.545725 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.545813 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.546030 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.546133 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.546335 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.546462 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.546667 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.546766 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.546978 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.547080 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.547282 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.547369 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.547589 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.547698 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.547903 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.548016 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.548206 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.548294 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.548510 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.548606 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.548827 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.548929 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.549135 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.549246 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.549436 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.549534 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.549747 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.549843 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.550045 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.550140 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.550351 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.550479 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.550694 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.550785 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.551001 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.551095 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.551305 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.551396 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.551610 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.551701 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.551914 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.552011 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.552218 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.552316 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.552523 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.552613 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.552826 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.552914 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.553130 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.553227 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.553432 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.553523 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.553748 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.553849 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.554058 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.554697 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.554902 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.555091 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.555225 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.555503 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.555598 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.555819 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.555919 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.556147 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:29:48.556244 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.556488 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.556585 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.556848 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.556944 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.557176 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.557266 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.557493 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.557613 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.557815 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.557934 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.558134 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.558233 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.558483 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.558665 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.558818 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.558959 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.559094 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.559231 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.559422 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.559578 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.559714 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.559856 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.560027 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.560166 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.560339 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.560490 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.560678 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.560824 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.560959 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.561102 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.561314 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.561469 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.561620 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.561755 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.561919 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.562057 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.562239 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.562382 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.562596 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.562924 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.563060 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.563277 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.563415 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.563618 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.563735 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.563943 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.564058 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.564254 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.564379 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.564597 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.564711 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.564916 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.565032 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.565235 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.565367 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.565570 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.565882 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.566223 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.566571 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.566770 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.567006 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.567157 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.567309 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.567453 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.567586 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.567809 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.567943 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.568131 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.568262 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.568451 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.568561 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.568797 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.568898 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.569119 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.569217 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.569443 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.569540 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.569811 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.570560 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.570704 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.570966 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.571183 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.571327 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.571496 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.571633 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.571773 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.571905 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.572053 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.572200 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.572367 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.572512 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.572650 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.572787 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.572986 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.573145 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.573320 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.573449 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.575897 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.576120 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.576251 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.576398 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.576533 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.576662 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.576790 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.576913 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.577120 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.577258 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.577385 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.577509 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.577633 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.577757 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.577883 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.578019 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.578145 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.578320 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.578463 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.579070 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.579070 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.579241 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.579241 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.579399 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.579399 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.579560 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.579643 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.579730 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.579817 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.579900 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.579979 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.580071 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.580153 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.580239 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.580320 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.580399 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.580478 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.580578 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.580660 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.580740 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.580826 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.580907 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.580995 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.581077 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.581157 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.581236 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.581322 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.581410 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.581574 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.581659 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.581739 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.581818 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.581896 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.581975 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.582067 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.582220 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.582402 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.582541 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.582748 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.582837 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.583070 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.583161 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.583386 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.583514 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.583705 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.583813 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.584020 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.584125 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.584498 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.584608 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.584689 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.584768 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.584947 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.585098 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.585262 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.585415 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.585715 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.585856 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.586029 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.586764 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.586764 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.586941 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.587021 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.587127 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.587212 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.587292 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.587378 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.587460 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.587624 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.587739 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.587940 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.588041 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.588260 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.588352 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.588578 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.588678 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.588889 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.588979 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.589229 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.589326 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.589543 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.589641 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.589856 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.589953 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.590190 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.590278 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.590530 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.590626 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.590846 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.590935 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.591159 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.591261 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.591472 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.591569 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.591826 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.591925 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.592140 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.592238 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.592477 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.592567 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.592798 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.592949 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.593125 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.593284 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.593447 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.593623 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.593782 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.593946 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.594102 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.594272 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.594451 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.594621 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.594766 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.594943 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.595092 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.595264 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.595445 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.595585 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.595790 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.595913 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.596117 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.596240 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.596452 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.596551 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.597023 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.597234 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.597333 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.597583 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.597697 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.597933 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.598032 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.598262 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.598358 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.598599 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.598688 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.598926 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.599017 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.599244 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.599343 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.599571 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.599660 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.599893 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.599988 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.600227 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.600316 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.600544 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.600637 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.600866 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.600975 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.601268 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.601356 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.601608 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.601702 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.601928 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.602017 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.602247 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.602336 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.602597 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.602688 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.602917 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.603006 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.603244 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.603334 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.603561 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.603649 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.603879 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.603965 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.604198 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.604285 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.604511 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.604599 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.604823 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.604918 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.605140 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.605235 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.605465 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.605552 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.605785 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.605882 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.606104 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.606193 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.606421 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.606598 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.606767 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.606866 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.607084 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.607180 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.607397 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.607491 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.607707 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.607805 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.608018 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.608115 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.608332 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.608422 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.608650 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.608739 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.608972 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.609059 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.609291 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.609388 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.609606 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.609693 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.609925 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.610013 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.610254 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.610340 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.610595 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.610686 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.610909 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.610998 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.611221 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.611318 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.611535 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.611632 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.611863 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.611950 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.612182 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.612281 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.612497 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.612584 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.612822 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.612909 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.613134 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.613229 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.613451 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.613541 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.613774 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.613862 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.614090 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.614185 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.614404 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.614542 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.614737 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.614826 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.615049 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.615146 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.615373 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.615467 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.615694 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.615789 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.616012 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.616101 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.616329 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.616415 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.617160 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.617307 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.617477 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.617572 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.617798 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.617895 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.618114 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.618213 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.618450 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.618541 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.618763 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.618851 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.619083 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.619187 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.619398 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.619486 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.619717 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.619994 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.620101 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.620340 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.620429 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.620654 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.620740 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.620983 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.621078 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.621298 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.621386 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.621616 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.621705 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.621935 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.622069 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.622252 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.622398 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.622621 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.622758 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.622916 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.623074 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.623277 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.623479 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.623614 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.623821 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.623930 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.624136 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.624224 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.624461 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.624560 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.624796 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.624923 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.625101 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.625189 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.625424 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.625525 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.625742 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.625848 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.626048 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.626137 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.626368 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.626508 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.626706 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.626785 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.627033 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.627113 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.627346 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.627469 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.627661 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.627741 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.627972 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.628049 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.628310 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.628457 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.628629 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.628770 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.628945 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.629088 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.629259 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.629401 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.629573 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.629712 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.629927 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.630016 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.630241 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.630339 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.630615 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.630708 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.630951 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.631049 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.631271 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.631361 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.631585 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.631672 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.631912 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.632008 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.632240 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.633002 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.633140 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.633230 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.633577 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.633674 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.633895 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.634216 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.634311 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.634560 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.634878 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.634981 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.635200 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.635289 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.635519 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.635607 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.635839 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.635936 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.636157 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.636298 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.636471 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.636635 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.636788 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.636955 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.637101 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.637295 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.637425 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.637688 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.637902 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.637993 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.638074 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.638310 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.638398 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.638659 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.638774 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.638978 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.639065 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.639292 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.639455 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.639603 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.639693 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.639915 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.640006 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.640234 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.640332 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.640544 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.640685 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.640860 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.641013 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.641155 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.641368 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.641538 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.641678 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.641821 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.642004 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.642139 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.642323 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.642497 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.642665 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.642817 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.642964 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.643112 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.643285 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.643447 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.643633 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.643779 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.643940 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.644063 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.644253 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.644352 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.644565 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.644662 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.644886 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.644975 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.645198 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.645314 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.645510 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.645601 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.645818 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.645905 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.646132 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.646220 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.646503 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.646611 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.646780 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.646879 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.647100 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.647198 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.647417 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.647513 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.647727 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.647872 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.648079 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.648217 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.648387 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.648474 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.648701 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.648811 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.649011 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.649100 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.649326 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.649413 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.649640 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.649742 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.649954 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.650051 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.650402 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.650563 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.650689 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.650781 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.650909 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.651024 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.651224 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.651400 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.651537 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.651717 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.651854 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.652042 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.652169 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.652371 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.652468 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.652690 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.652779 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.653009 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.653106 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.653330 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.653427 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.653642 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.653737 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.653966 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.654045 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.654284 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.654374 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.654629 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.654718 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.654940 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.655026 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.655249 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.655345 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.655580 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.655668 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.655899 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.655995 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.656216 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.656305 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.656547 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.656636 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.656878 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.656972 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.657197 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.657287 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.657512 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.657598 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.657830 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.657916 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.658143 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.658241 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.658476 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.658566 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.658798 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.658898 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.659114 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.659210 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.659430 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.659516 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.659740 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.659842 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.660055 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.660148 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.660373 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.660461 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.660689 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.660785 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.661002 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.661089 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.661322 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.661457 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.661641 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.661743 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.661954 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.662040 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.662270 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.662358 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.662611 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.662703 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.662929 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.663015 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.663244 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.663341 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.663608 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.663745 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.663933 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.664097 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.664247 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.664340 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.664551 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.664678 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.664868 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.664996 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.665182 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.665314 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.665496 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.665628 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.665811 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.665946 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.666133 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.666265 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.666475 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.666614 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.666800 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.666938 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.667117 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.667283 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.667430 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.667663 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.667757 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.667985 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.668074 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.668307 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.668397 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.668627 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.668742 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.668940 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.669102 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.669253 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.669419 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.669571 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.669735 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.669904 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.670046 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.670216 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.670363 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.670553 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.670704 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.670866 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.671025 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.671197 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.671345 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.671515 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.671657 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.671846 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.672083 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.672274 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.672403 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.672593 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.672722 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.672908 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.673025 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.673334 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.673425 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.673644 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.673737 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.673957 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.674047 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.674289 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.674376 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.674645 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.674745 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.674956 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.675044 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.675267 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.675356 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.675587 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.675681 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.675895 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.675991 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.676229 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.676315 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.676563 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.676650 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.676881 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.676971 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.677203 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.677297 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.677517 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.677663 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.677851 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.677982 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.678184 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.678301 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.678531 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.678659 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.678865 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.678994 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.679836 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.679990 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.680149 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.680268 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.680467 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.680571 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.680782 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.680879 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.681115 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.681203 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.681435 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.681531 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.681750 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.681843 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.682069 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.682160 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.682380 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.682511 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.682719 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.682808 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.683051 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.683138 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.683368 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.683457 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.683687 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.683783 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.684005 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.684208 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.684307 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.684545 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.684634 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.684863 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.684951 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.685192 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.685289 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.685523 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.685612 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.685838 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.685927 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.686157 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.686254 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.686507 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.686606 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.686810 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.686900 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.687123 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.687222 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.687453 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.687547 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.687762 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.687850 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.688075 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.688170 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.688388 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.688477 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.688700 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.688786 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.689015 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.689106 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.689327 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.689424 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.689656 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.689752 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.689967 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.690103 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.690298 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.690388 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.690656 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.690761 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.690989 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.691103 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.691318 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.691430 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.691633 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.691777 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.691956 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.692044 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.692276 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.692387 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.692581 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.692680 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.692897 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.693032 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.693204 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.693293 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.693518 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.693617 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.693830 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.693919 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.694147 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.694257 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.694485 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.694598 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.695415 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.695519 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.695760 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.695882 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.696121 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.696223 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.696455 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.696564 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.696779 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.696876 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.697105 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.697195 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.697436 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.697529 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.697752 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.697850 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.698063 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.698160 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.698376 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.698514 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.698760 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.698874 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.699075 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.699164 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.699424 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.699521 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.699740 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.699832 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.700035 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.700163 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.700347 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.700438 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.700659 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.700758 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.700994 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.701091 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.701307 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.701397 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.701637 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.701728 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.701954 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.702044 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.702266 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.702356 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.702600 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.702694 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.702912 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.703002 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.703236 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.703328 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.703557 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.703648 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.703884 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.703974 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.704209 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.704296 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.704535 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.704624 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.704868 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.705117 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.705212 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.705455 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.705553 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.705778 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.705867 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.706100 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.706196 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.706424 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.706531 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.706769 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.706858 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.707090 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.707177 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.707408 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.707497 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.707727 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.707814 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.708043 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.708132 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.708361 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.708450 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.708681 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.708768 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.709003 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.709168 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.709341 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.709572 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.709686 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.709909 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.709999 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.710229 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.710364 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.710623 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.710877 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.711145 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.711234 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.711476 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.711573 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.711798 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.711894 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.712120 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.712231 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.712439 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.712536 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.712759 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.712849 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.713078 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.713181 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.713414 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.713511 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.713731 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.713832 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.714052 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.714151 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.714371 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.714513 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.714719 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.714811 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.715040 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.715131 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.715359 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.715448 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.715679 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.715766 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.716011 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.716101 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.716353 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.716440 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.716668 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.716772 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.716986 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.717081 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.717307 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.717402 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.717627 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.717730 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.717943 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.718158 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.718255 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.718504 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.718608 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.718851 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.718941 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.719188 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.719278 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.719501 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.719603 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.719820 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.719909 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.720145 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.720233 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.720480 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.720578 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.720795 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.720884 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.721107 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.721195 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.721432 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.721534 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.722005 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.722144 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.722318 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.722408 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.722672 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.722932 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.723031 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.723256 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.723344 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.723603 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.723702 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.723918 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.724004 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.724258 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.724465 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.724584 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.724827 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.724917 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.725149 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.725237 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.725485 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.725640 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.725825 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.726508 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.726699 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.726864 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.727019 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.727179 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.727381 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.728741 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.728982 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.729306 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.729402 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.729496 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.729580 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.729658 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.729733 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.729815 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.729895 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.729989 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.730080 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.730080 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.730236 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.730318 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.730398 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.730556 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.730653 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.730790 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.730932 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.731084 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.731246 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.731389 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.731515 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.731613 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.731697 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.731777 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.731927 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.732019 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.732246 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.732334 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.732562 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.732648 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.732878 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.732981 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.733191 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.733281 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.733504 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.733712 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.733876 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.734019 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.734150 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.734297 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.734424 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.734551 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.734756 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.734899 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.735077 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.735174 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.735389 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.735494 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.735704 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.735794 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.736018 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.736105 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.736334 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.736431 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.736654 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.736750 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.736973 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.737062 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.737296 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.737617 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.737939 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.738028 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.738260 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.738359 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.738598 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.738702 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.738917 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.739006 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.739239 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.739329 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.739556 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.739813 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.739903 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.740163 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.740251 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.740496 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.740671 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.740811 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.740908 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.741127 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.741217 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.741484 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.741630 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.742421 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.742573 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.742796 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.742919 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.743125 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.743219 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.743405 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.743502 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.743724 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.743816 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.744060 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.744158 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.744454 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.744968 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.745090 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.745289 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.745387 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.745471 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.745552 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.745634 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.745715 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.745902 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.746003 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.746248 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.746345 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.746613 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.746705 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.746937 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.747028 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.747259 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.747401 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.747584 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.747726 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.747937 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.748048 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.748269 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.748409 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.748615 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.748736 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.748948 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.749044 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.749278 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.749366 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.749602 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.749699 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.749925 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.750021 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.750247 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.750336 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.750592 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.750700 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.750917 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.751005 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.751239 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.751355 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.751553 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.751653 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.751870 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.751960 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.752187 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.752308 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.752504 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.752632 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.752820 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.752959 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.753149 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.753292 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.753496 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.753612 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.753826 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.753946 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.754172 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.754283 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.754631 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.754742 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.754968 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.755069 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.755293 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.755444 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.755609 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.755700 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.755928 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.756026 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.756248 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.756347 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.756572 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.756661 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.756922 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.757009 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.757264 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.757371 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.757577 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.757673 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.757897 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.758017 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.758226 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.758325 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.758571 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.758661 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.758889 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.758980 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.759254 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.759352 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.759523 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.759614 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.759838 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.760000 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.760154 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.760322 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.760471 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.760652 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.760787 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.760973 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.761106 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.761316 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.761425 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.761668 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.761758 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.762011 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.762101 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.762342 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.762482 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.762683 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.762774 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.762998 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.763089 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.763317 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.763408 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.763635 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.763723 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.763949 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.764049 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.764264 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.764361 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.764580 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.764668 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.764891 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.764980 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.765206 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.765293 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.765520 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.765619 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.765835 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.765937 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.766150 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.766240 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.766481 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.766585 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.766807 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.766904 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.767120 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.767209 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.767433 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.767530 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.767746 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.767835 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.768058 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.768167 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.768370 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.768469 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.768684 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.768773 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.769000 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.769091 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.769315 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.769405 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.769629 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.769718 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.769955 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.770043 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.770269 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.770358 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.770606 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.770710 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.770939 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.771027 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.771280 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.771379 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.771598 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.771687 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.771930 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.772031 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.772251 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.772340 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.772577 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.772664 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.772931 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.773041 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.773250 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.773340 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.773583 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.773669 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.773935 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.774107 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.774250 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.774341 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.774615 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.774746 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.774941 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.775046 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.775260 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.775348 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.775579 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.775665 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.775899 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.775991 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.776220 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.776317 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.776540 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.776629 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.776867 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.776963 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.777207 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.777302 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.777544 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.777635 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.777880 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.777968 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.778205 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.778305 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.778563 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.778671 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.778890 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.778979 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.779209 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.779298 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.779530 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.779631 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.779847 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.779935 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.780098 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 17:29:48.780197 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.780474 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.780791 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.781110 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.781434 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.781761 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.782101 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.782452 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.782837 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.783252 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.783595 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.783953 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.784277 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.784636 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.785013 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.785349 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.785698 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.785981 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:29:48.786232 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 17:29:48.843949 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO dbcounter [None req-3c0146d8-f232-4a52-89a5-23357f14d09d None None] Registered counter for database nova_api Jul 12 17:29:48.850233 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO dbcounter [None req-736d82cd-a2cf-4d54-898d-3c0616449916 None None] Registered counter for database nova_api Jul 12 17:29:48.957004 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG oslo_db.sqlalchemy.engines [None req-3c0146d8-f232-4a52-89a5-23357f14d09d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103898) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:29:48.963089 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG oslo_db.sqlalchemy.engines [None req-736d82cd-a2cf-4d54-898d-3c0616449916 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103897) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:29:48.963629 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG dbcounter [-] [103898] Writer thread running {{(pid=103898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:29:48.969498 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG dbcounter [-] [103897] Writer thread running {{(pid=103897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:29:49.021018 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.context [None req-3c0146d8-f232-4a52-89a5-23357f14d09d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3edbf35d-1b15-4b4d-a347-1a17c7474c01(cell1) {{(pid=103898) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 17:29:49.025006 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG oslo_concurrency.lockutils [None req-3c0146d8-f232-4a52-89a5-23357f14d09d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:49.026687 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG oslo_concurrency.lockutils [None req-3c0146d8-f232-4a52-89a5-23357f14d09d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:49.026993 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.context [None req-736d82cd-a2cf-4d54-898d-3c0616449916 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3edbf35d-1b15-4b4d-a347-1a17c7474c01(cell1) {{(pid=103897) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 17:29:49.027491 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG oslo_concurrency.lockutils [None req-3c0146d8-f232-4a52-89a5-23357f14d09d None None] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:49.029611 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG oslo_concurrency.lockutils [None req-3c0146d8-f232-4a52-89a5-23357f14d09d None None] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:49.031010 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG oslo_concurrency.lockutils [None req-736d82cd-a2cf-4d54-898d-3c0616449916 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:49.031644 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO dbcounter [None req-3c0146d8-f232-4a52-89a5-23357f14d09d None None] Registered counter for database nova_cell0 Jul 12 17:29:49.032653 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG oslo_concurrency.lockutils [None req-736d82cd-a2cf-4d54-898d-3c0616449916 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:49.033487 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG oslo_concurrency.lockutils [None req-736d82cd-a2cf-4d54-898d-3c0616449916 None None] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:49.035596 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO dbcounter [None req-3c0146d8-f232-4a52-89a5-23357f14d09d None None] Registered counter for database nova_cell1 Jul 12 17:29:49.035711 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG oslo_concurrency.lockutils [None req-736d82cd-a2cf-4d54-898d-3c0616449916 None None] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:49.037711 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO dbcounter [None req-736d82cd-a2cf-4d54-898d-3c0616449916 None None] Registered counter for database nova_cell0 Jul 12 17:29:49.042304 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO dbcounter [None req-736d82cd-a2cf-4d54-898d-3c0616449916 None None] Registered counter for database nova_cell1 Jul 12 17:29:49.045992 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG oslo_db.sqlalchemy.engines [None req-3c0146d8-f232-4a52-89a5-23357f14d09d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103898) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:29:49.048314 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG oslo_db.sqlalchemy.engines [None req-3c0146d8-f232-4a52-89a5-23357f14d09d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103898) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:29:49.050105 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG oslo_db.sqlalchemy.engines [None req-736d82cd-a2cf-4d54-898d-3c0616449916 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103897) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:29:49.052290 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG oslo_db.sqlalchemy.engines [None req-736d82cd-a2cf-4d54-898d-3c0616449916 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103897) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:29:49.053464 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG dbcounter [-] [103898] Writer thread running {{(pid=103898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:29:49.057895 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG dbcounter [-] [103897] Writer thread running {{(pid=103897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:29:49.059314 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG dbcounter [-] [103898] Writer thread running {{(pid=103898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:29:49.063009 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG dbcounter [-] [103897] Writer thread running {{(pid=103897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:29:49.202253 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO dbcounter [None req-3c0146d8-f232-4a52-89a5-23357f14d09d None None] Registered counter for database nova_cell0 Jul 12 17:29:49.207398 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO dbcounter [None req-736d82cd-a2cf-4d54-898d-3c0616449916 None None] Registered counter for database nova_cell0 Jul 12 17:29:49.212390 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG oslo_db.sqlalchemy.engines [None req-3c0146d8-f232-4a52-89a5-23357f14d09d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103898) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:29:49.217443 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG dbcounter [-] [103898] Writer thread running {{(pid=103898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:29:49.217626 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG oslo_db.sqlalchemy.engines [None req-736d82cd-a2cf-4d54-898d-3c0616449916 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103897) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:29:49.222370 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG dbcounter [-] [103897] Writer thread running {{(pid=103897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:29:49.667432 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: WARNING keystonemiddleware.auth_token [None req-3c0146d8-f232-4a52-89a5-23357f14d09d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 17:29:49.674816 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: WARNING keystonemiddleware.auth_token [None req-3c0146d8-f232-4a52-89a5-23357f14d09d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 17:29:49.795915 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: WARNING keystonemiddleware.auth_token [None req-736d82cd-a2cf-4d54-898d-3c0616449916 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 17:29:49.803374 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: WARNING keystonemiddleware.auth_token [None req-736d82cd-a2cf-4d54-898d-3c0616449916 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 17:29:50.019030 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: WARNING keystonemiddleware.auth_token [None req-3c0146d8-f232-4a52-89a5-23357f14d09d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 17:29:50.025817 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: WARNING keystonemiddleware.auth_token [None req-3c0146d8-f232-4a52-89a5-23357f14d09d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 17:29:50.031411 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559fdc9fb9c0 pid: 103898 (default app) Jul 12 17:29:50.033736 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-3c0146d8-f232-4a52-89a5-23357f14d09d None None] Calling method '>' {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:50.035008 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-3c0146d8-f232-4a52-89a5-23357f14d09d None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001997 Jul 12 17:29:50.035449 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Tue Jul 12 17:29:50 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:29:50.152319 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: WARNING keystonemiddleware.auth_token [None req-736d82cd-a2cf-4d54-898d-3c0616449916 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 17:29:50.158512 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: WARNING keystonemiddleware.auth_token [None req-736d82cd-a2cf-4d54-898d-3c0616449916 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 17:29:50.164474 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559fdc9fb9c0 pid: 103897 (default app) Jul 12 17:31:12.835297 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-3c0146d8-f232-4a52-89a5-23357f14d09d None None] Calling method '>' {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:12.836988 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-3c0146d8-f232-4a52-89a5-23357f14d09d None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002251 Jul 12 17:31:12.837543 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jul 12 17:31:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:31:12.851733 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG dbcounter [-] [103897] Writing DB stats nova_api:SELECT=3 {{(pid=103897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:31:12.852980 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG dbcounter [-] [103897] Writing DB stats nova_cell0:SELECT=3 {{(pid=103897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:31:12.854086 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG dbcounter [-] [103897] Writing DB stats nova_cell1:SELECT=3 {{(pid=103897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:31:12.855074 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG dbcounter [-] [103897] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:31:13.773585 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-1f876bac-fbfb-4876-8b98-7863c6b6c73b admin admin] Calling method '>' {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:13.804204 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-1f876bac-fbfb-4876-8b98-7863c6b6c73b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.959177 Jul 12 17:31:13.804938 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1291 bytes} [Tue Jul 12 17:31:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:16.132506 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-3c0146d8-f232-4a52-89a5-23357f14d09d None None] Calling method '>' {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:16.133501 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-3c0146d8-f232-4a52-89a5-23357f14d09d None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Jul 12 17:31:16.139033 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jul 12 17:31:16 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:31:16.621421 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-9fe7dfff-ffcc-4555-9de4-4f0e7f69ceaa admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "name": "cirros256", "disk": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:16.640367 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 17:31:16.640367 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: warnings.warn(msg) Jul 12 17:31:16.728662 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-9fe7dfff-ffcc-4555-9de4-4f0e7f69ceaa admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.588617 Jul 12 17:31:16.729553 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1282 bytes} [Tue Jul 12 17:31:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 17:31:16.955167 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-18a42df8-11d1-47ed-9aac-2f2f73605f32 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:16.957740 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 17:31:16.957740 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: warnings.warn(msg) Jul 12 17:31:16.977624 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG dbcounter [-] [103898] Writing DB stats nova_api:SELECT=3 {{(pid=103898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:31:16.978495 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG dbcounter [-] [103898] Writing DB stats nova_cell0:SELECT=3 {{(pid=103898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:31:16.979206 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG dbcounter [-] [103898] Writing DB stats nova_cell1:SELECT=3 {{(pid=103898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:31:16.979922 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG dbcounter [-] [103898] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:31:17.231097 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-18a42df8-11d1-47ed-9aac-2f2f73605f32 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.493383 Jul 12 17:31:17.232223 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1335 bytes} [Tue Jul 12 17:31:16 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:19.505140 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-9fe7dfff-ffcc-4555-9de4-4f0e7f69ceaa admin admin] Calling method '>' {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:19.506160 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-9fe7dfff-ffcc-4555-9de4-4f0e7f69ceaa admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jul 12 17:31:19.506853 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jul 12 17:31:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:31:20.209986 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-2d437065-4d2a-47e8-ac04-1d91c5fd7926 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "disk": 5, "vcpus": 1, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M"}} {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:20.228564 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 17:31:20.228564 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: warnings.warn(msg) Jul 12 17:31:20.341193 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-2d437065-4d2a-47e8-ac04-1d91c5fd7926 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.828195 Jul 12 17:31:20.342222 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1282 bytes} [Tue Jul 12 17:31:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:31:20.355176 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-7c0b9885-5b81-4e02-867f-788d5a83d23d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:20.356778 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 17:31:20.356778 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: warnings.warn(msg) Jul 12 17:31:20.468706 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-7c0b9885-5b81-4e02-867f-788d5a83d23d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117843 Jul 12 17:31:20.469545 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1335 bytes} [Tue Jul 12 17:31:20 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:22.716230 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-2d437065-4d2a-47e8-ac04-1d91c5fd7926 admin admin] Calling method '>' {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:22.717255 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-2d437065-4d2a-47e8-ac04-1d91c5fd7926 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 12 17:31:22.717683 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jul 12 17:31:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:31:23.154752 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-236f933a-790e-4e6a-9cb3-b3fbc229863f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "name": "ds1G", "ram": 1024, "id": "d2", "disk": 10, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:23.229065 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-236f933a-790e-4e6a-9cb3-b3fbc229863f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.504669 Jul 12 17:31:23.229784 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1282 bytes} [Tue Jul 12 17:31:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 17:31:23.241581 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-03fe3ed5-c5fc-4240-8df8-e90a1cdf6bbf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:23.325155 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-03fe3ed5-c5fc-4240-8df8-e90a1cdf6bbf admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087209 Jul 12 17:31:23.325740 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1335 bytes} [Tue Jul 12 17:31:23 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:31:25.591414 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-236f933a-790e-4e6a-9cb3-b3fbc229863f admin admin] Calling method '>' {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:25.592437 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-236f933a-790e-4e6a-9cb3-b3fbc229863f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 12 17:31:25.592857 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jul 12 17:31:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:31:26.088986 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-a48c5a24-c6fe-42f7-95f7-cfaaadbe75c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "d3", "name": "ds2G", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "vcpus": 2}} {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:26.172393 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-a48c5a24-c6fe-42f7-95f7-cfaaadbe75c9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.573136 Jul 12 17:31:26.173473 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1282 bytes} [Tue Jul 12 17:31:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 17:31:26.188770 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-18caaea8-fcf6-4f2f-be38-750fa656b63a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:26.261497 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-18caaea8-fcf6-4f2f-be38-750fa656b63a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077694 Jul 12 17:31:26.271399 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1335 bytes} [Tue Jul 12 17:31:26 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:28.499259 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-a48c5a24-c6fe-42f7-95f7-cfaaadbe75c9 admin admin] Calling method '>' {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:28.500426 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-a48c5a24-c6fe-42f7-95f7-cfaaadbe75c9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 12 17:31:28.501078 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jul 12 17:31:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:31:28.953810 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-b3036264-8b57-4b5f-a7cf-ce5422052d5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds4G", "disk": 20, "vcpus": 4, "rxtx_factor": 1.0, "ram": 4096, "id": "d4"}} {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:29.029802 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-b3036264-8b57-4b5f-a7cf-ce5422052d5e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.522281 Jul 12 17:31:29.030716 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1282 bytes} [Tue Jul 12 17:31:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:31:29.043383 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-da0fa163-9f36-4bb4-8a99-21afaeda0763 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:29.131312 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-da0fa163-9f36-4bb4-8a99-21afaeda0763 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091755 Jul 12 17:31:29.132180 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1335 bytes} [Tue Jul 12 17:31:29 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:31.512264 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-b3036264-8b57-4b5f-a7cf-ce5422052d5e admin admin] Calling method '>' {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:31.513326 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-b3036264-8b57-4b5f-a7cf-ce5422052d5e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001632 Jul 12 17:31:31.513723 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jul 12 17:31:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:31:31.966315 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-5a470790-4205-47ce-b45e-3e6adce5b356 admin admin] Calling method '>' {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:31.989784 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-5a470790-4205-47ce-b45e-3e6adce5b356 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.468769 Jul 12 17:31:31.990322 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1291 bytes} [Tue Jul 12 17:31:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:31:34.263704 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-b3036264-8b57-4b5f-a7cf-ce5422052d5e admin admin] Calling method '>' {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:34.264720 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-b3036264-8b57-4b5f-a7cf-ce5422052d5e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jul 12 17:31:34.265134 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jul 12 17:31:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:31:34.698228 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-0478a17b-bcdb-4a8f-811a-4153301c1ec0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "vcpus": 1, "ram": 512, "disk": 1, "os-flavor-access:is_public": true, "id": "1", "swap": 0}} {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:34.766838 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-0478a17b-bcdb-4a8f-811a-4153301c1ec0 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.495404 Jul 12 17:31:34.767393 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1282 bytes} [Tue Jul 12 17:31:34 2022] POST /compute/v2.1/flavors => generated 402 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:31:34.780120 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-631471b3-3d46-468d-ac03-64dc5d8fba28 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:34.862850 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-631471b3-3d46-468d-ac03-64dc5d8fba28 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086197 Jul 12 17:31:34.863591 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1332 bytes} [Tue Jul 12 17:31:34 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:37.346344 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-0478a17b-bcdb-4a8f-811a-4153301c1ec0 admin admin] Calling method '>' {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:37.347389 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-0478a17b-bcdb-4a8f-811a-4153301c1ec0 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Jul 12 17:31:37.347791 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jul 12 17:31:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:31:37.763636 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-2cb3ec6d-c8db-42de-bfc5-06ec3bac28df admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 20, "name": "m1.small", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "ram": 2048}} {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:37.840554 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-2cb3ec6d-c8db-42de-bfc5-06ec3bac28df admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.486523 Jul 12 17:31:37.841033 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1282 bytes} [Tue Jul 12 17:31:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:31:37.854087 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-c22fb2b5-0fb1-499e-85af-983a342ee3a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:37.930618 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-c22fb2b5-0fb1-499e-85af-983a342ee3a2 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080127 Jul 12 17:31:37.931416 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1332 bytes} [Tue Jul 12 17:31:37 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:40.209828 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-2cb3ec6d-c8db-42de-bfc5-06ec3bac28df admin admin] Calling method '>' {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:40.210978 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-2cb3ec6d-c8db-42de-bfc5-06ec3bac28df admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001592 Jul 12 17:31:40.211484 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jul 12 17:31:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:31:40.580748 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-0340f08b-3090-4092-87e1-78ac18d32fbb admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "vcpus": 2, "swap": 0, "ram": 4096, "disk": 40, "id": "3"}} {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:40.669559 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-0340f08b-3090-4092-87e1-78ac18d32fbb admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.452030 Jul 12 17:31:40.670120 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1282 bytes} [Tue Jul 12 17:31:40 2022] POST /compute/v2.1/flavors => generated 406 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:31:40.682200 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-59b2eba9-8dec-41ca-9ac3-36be79c873d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:40.758349 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-59b2eba9-8dec-41ca-9ac3-36be79c873d4 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079780 Jul 12 17:31:40.758967 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1332 bytes} [Tue Jul 12 17:31:40 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:43.045137 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-0340f08b-3090-4092-87e1-78ac18d32fbb admin admin] Calling method '>' {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:43.046159 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-0340f08b-3090-4092-87e1-78ac18d32fbb admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jul 12 17:31:43.046618 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jul 12 17:31:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:31:43.524098 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-678ec5bd-80df-4129-8e4b-a8c07aedfed8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "id": "4", "ram": 8192, "os-flavor-access:is_public": true, "disk": 80, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:43.528785 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG dbcounter [-] [103897] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:31:43.613158 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-678ec5bd-80df-4129-8e4b-a8c07aedfed8 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.559924 Jul 12 17:31:43.620629 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1282 bytes} [Tue Jul 12 17:31:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 17:31:43.628005 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-d1d6f753-c278-4ebd-8722-c32997cfda47 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:43.723476 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-d1d6f753-c278-4ebd-8722-c32997cfda47 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101480 Jul 12 17:31:43.724357 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1332 bytes} [Tue Jul 12 17:31:43 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:46.004071 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-678ec5bd-80df-4129-8e4b-a8c07aedfed8 admin admin] Calling method '>' {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:46.005205 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-678ec5bd-80df-4129-8e4b-a8c07aedfed8 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 Jul 12 17:31:46.005786 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jul 12 17:31:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:31:46.451845 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-768c8fcc-7615-4746-bee9-ede7f861464e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 8, "disk": 160, "name": "m1.xlarge", "ram": 16384, "rxtx_factor": 1.0}} {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:46.521028 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-768c8fcc-7615-4746-bee9-ede7f861464e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.509268 Jul 12 17:31:46.521918 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1282 bytes} [Tue Jul 12 17:31:46 2022] POST /compute/v2.1/flavors => generated 408 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 17:31:46.534496 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-6d052ffe-80ff-4e4d-bdc0-305f7880e04e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:46.654839 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-6d052ffe-80ff-4e4d-bdc0-305f7880e04e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.124764 Jul 12 17:31:46.655620 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1332 bytes} [Tue Jul 12 17:31:46 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:32:07.790190 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-768c8fcc-7615-4746-bee9-ede7f861464e admin admin] Calling method '>' {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:07.791275 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-768c8fcc-7615-4746-bee9-ede7f861464e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Jul 12 17:32:07.791673 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jul 12 17:32:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:32:08.212550 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-bf5c3e96-7953-4dda-98cb-b478506b0949 admin admin] Calling method '>' {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:08.230561 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-bf5c3e96-7953-4dda-98cb-b478506b0949 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.432202 Jul 12 17:32:08.231562 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1291 bytes} [Tue Jul 12 17:32:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:32:09.329819 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-768c8fcc-7615-4746-bee9-ede7f861464e admin admin] Calling method '>' {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:09.330921 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-768c8fcc-7615-4746-bee9-ede7f861464e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 12 17:32:09.331319 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jul 12 17:32:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:32:09.910311 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-10a81a3c-df85-415d-bcba-29b4d76454c2 admin admin] Calling method '>' {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:09.916378 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.wsgi [None req-10a81a3c-df85-415d-bcba-29b4d76454c2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 12 17:32:09.919677 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-10a81a3c-df85-415d-bcba-29b4d76454c2 admin admin] Request method failure captured: Jul 12 17:32:09.919677 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 12 17:32:09.919677 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: Accept: application/json Jul 12 17:32:09.919677 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: Accept-Encoding: gzip, deflate Jul 12 17:32:09.919677 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: Connection: keep-alive Jul 12 17:32:09.919677 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: Content-Length: 0 Jul 12 17:32:09.919677 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: Host: 10.222.0.16 Jul 12 17:32:09.919677 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: Openstack-Api-Version: compute 2.90 Jul 12 17:32:09.919677 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: Openstack-System-Scope: None Jul 12 17:32:09.919677 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: User-Agent: python-novaclient Jul 12 17:32:09.919677 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Auth-Token: gAAAAABizbAZ9h-6g_1C0Dn2gjjX_0xJw8d105BY-27QfhgCy2j_X-kbbT48UVz_U5Ol5aM8z_khvk-oD6QdqA6mRifaokKor2lkf4ErXWUKJM4oECm17A3Oe52M20jP6IFqx7xK1UVnHkT1BkRntW4G51p10rk79k4SLH-34xh5HX8sVfpNleY Jul 12 17:32:09.919677 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Domain-Id: None Jul 12 17:32:09.919677 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Domain-Name: None Jul 12 17:32:09.919677 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Identity-Status: Confirmed Jul 12 17:32:09.919677 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Is-Admin-Project: True Jul 12 17:32:09.919677 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 17:32:09.919677 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Project-Domain-Id: default Jul 12 17:32:09.919677 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Project-Domain-Name: Default Jul 12 17:32:09.919677 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Project-Id: 1d1f69915b004b66af4c48b7c59a15d8 Jul 12 17:32:09.919677 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Project-Name: admin Jul 12 17:32:09.919677 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Role: admin,reader,member Jul 12 17:32:09.919677 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Roles: admin,reader,member Jul 12 17:32:09.921236 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d1f69915b004b66af4c48b7c59a15d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1d1f69915b004b66af4c48b7c59a15d8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d1f69915b004b66af4c48b7c59a15d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1d1f69915b004b66af4c48b7c59a15d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:32:09.921236 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Tenant: admin Jul 12 17:32:09.921236 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Tenant-Id: 1d1f69915b004b66af4c48b7c59a15d8 Jul 12 17:32:09.921236 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Tenant-Name: admin Jul 12 17:32:09.921236 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-User: admin Jul 12 17:32:09.921236 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-User-Domain-Id: default Jul 12 17:32:09.921236 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-User-Domain-Name: Default Jul 12 17:32:09.921236 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-User-Id: df85f597d0ba471381a5a8f9b6886705 Jul 12 17:32:09.921236 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-User-Name: admin Jul 12 17:32:09.921236 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: method: > Jul 12 17:32:09.921236 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: exception: Flavor 42 could not be found. Jul 12 17:32:09.921236 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: action_args: {'id': '42'} Jul 12 17:32:09.921236 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:32:09.921236 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:32:09.923110 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 17:32:09.923110 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 17:32:09.923110 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 17:32:09.923110 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 17:32:09.923110 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 17:32:09.923110 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 17:32:09.923110 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 17:32:09.923110 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 17:32:09.923110 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 17:32:09.923110 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:32:09.923110 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 17:32:09.923110 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 17:32:09.923110 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 12 17:32:09.923110 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi Jul 12 17:32:09.923110 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:32:09.923110 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi Jul 12 17:32:09.923110 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:32:09.923110 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:32:09.923110 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:32:09.924658 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:32:09.924658 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:32:09.924658 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:32:09.924658 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:32:09.924658 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 17:32:09.924658 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:32:09.924658 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 12 17:32:09.924658 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi Jul 12 17:32:09.924658 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:32:09.924658 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi Jul 12 17:32:09.924658 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:32:09.924658 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:32:09.924658 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:32:09.924658 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:32:09.924658 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:32:09.924658 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 12 17:32:09.924658 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi Jul 12 17:32:09.924658 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-10a81a3c-df85-415d-bcba-29b4d76454c2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:32:09.926157 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-10a81a3c-df85-415d-bcba-29b4d76454c2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.451671 Jul 12 17:32:09.926157 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1190 bytes} [Tue Jul 12 17:32:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 453 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 17:32:09.933256 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-f3eb3137-bcb9-4660-a6a1-e898224cca14 admin admin] Calling method '>' {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:09.936324 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG dbcounter [-] [103898] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:09.955548 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-f3eb3137-bcb9-4660-a6a1-e898224cca14 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027643 Jul 12 17:32:09.956292 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1210 bytes} [Tue Jul 12 17:32:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:32:09.967413 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-0f280c73-b5ce-4257-be62-2fe05c5b35d9 admin admin] Calling method '>' {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:09.992817 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-0f280c73-b5ce-4257-be62-2fe05c5b35d9 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030052 Jul 12 17:32:09.993389 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1210 bytes} [Tue Jul 12 17:32:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:32:10.004293 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-390f71ec-4d6e-47c3-b5eb-6a560147dccd admin admin] Calling method '>' {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:10.011266 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.wsgi [None req-390f71ec-4d6e-47c3-b5eb-6a560147dccd admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 12 17:32:10.014793 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-390f71ec-4d6e-47c3-b5eb-6a560147dccd admin admin] Request method failure captured: Jul 12 17:32:10.014793 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 12 17:32:10.014793 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: Accept: application/json Jul 12 17:32:10.014793 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: Accept-Encoding: gzip, deflate Jul 12 17:32:10.014793 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: Connection: keep-alive Jul 12 17:32:10.014793 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: Content-Length: 0 Jul 12 17:32:10.014793 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: Host: 10.222.0.16 Jul 12 17:32:10.014793 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: Openstack-Api-Version: compute 2.90 Jul 12 17:32:10.014793 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: Openstack-System-Scope: None Jul 12 17:32:10.014793 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: User-Agent: python-novaclient Jul 12 17:32:10.014793 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Auth-Token: gAAAAABizbAZ9h-6g_1C0Dn2gjjX_0xJw8d105BY-27QfhgCy2j_X-kbbT48UVz_U5Ol5aM8z_khvk-oD6QdqA6mRifaokKor2lkf4ErXWUKJM4oECm17A3Oe52M20jP6IFqx7xK1UVnHkT1BkRntW4G51p10rk79k4SLH-34xh5HX8sVfpNleY Jul 12 17:32:10.014793 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Domain-Id: None Jul 12 17:32:10.014793 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Domain-Name: None Jul 12 17:32:10.014793 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Identity-Status: Confirmed Jul 12 17:32:10.014793 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Is-Admin-Project: True Jul 12 17:32:10.014793 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 17:32:10.014793 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Project-Domain-Id: default Jul 12 17:32:10.014793 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Project-Domain-Name: Default Jul 12 17:32:10.014793 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Project-Id: 1d1f69915b004b66af4c48b7c59a15d8 Jul 12 17:32:10.014793 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Project-Name: admin Jul 12 17:32:10.014793 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Role: admin,reader,member Jul 12 17:32:10.014793 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Roles: admin,reader,member Jul 12 17:32:10.020683 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d1f69915b004b66af4c48b7c59a15d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1d1f69915b004b66af4c48b7c59a15d8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d1f69915b004b66af4c48b7c59a15d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1d1f69915b004b66af4c48b7c59a15d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:32:10.020683 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Tenant: admin Jul 12 17:32:10.020683 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Tenant-Id: 1d1f69915b004b66af4c48b7c59a15d8 Jul 12 17:32:10.020683 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Tenant-Name: admin Jul 12 17:32:10.020683 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-User: admin Jul 12 17:32:10.020683 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-User-Domain-Id: default Jul 12 17:32:10.020683 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-User-Domain-Name: Default Jul 12 17:32:10.020683 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-User-Id: df85f597d0ba471381a5a8f9b6886705 Jul 12 17:32:10.020683 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-User-Name: admin Jul 12 17:32:10.020683 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: method: > Jul 12 17:32:10.020683 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: exception: Flavor 42 could not be found. Jul 12 17:32:10.020683 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: action_args: {'id': '42'} Jul 12 17:32:10.020683 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:32:10.020683 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:32:10.021621 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 17:32:10.021621 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 17:32:10.021621 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 17:32:10.021621 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 17:32:10.021621 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 17:32:10.021621 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 17:32:10.021621 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 17:32:10.021621 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 17:32:10.021621 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 17:32:10.021621 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:32:10.021621 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 17:32:10.021621 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 17:32:10.021621 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 12 17:32:10.021621 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi Jul 12 17:32:10.021621 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:32:10.021621 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi Jul 12 17:32:10.021621 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:32:10.021621 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:32:10.021621 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:32:10.022759 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:32:10.022759 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:32:10.022759 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:32:10.022759 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:32:10.022759 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 17:32:10.022759 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:32:10.022759 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 12 17:32:10.022759 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi Jul 12 17:32:10.022759 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:32:10.022759 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi Jul 12 17:32:10.022759 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:32:10.022759 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:32:10.022759 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:32:10.022759 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:32:10.022759 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:32:10.022759 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 12 17:32:10.022759 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi Jul 12 17:32:10.022759 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-390f71ec-4d6e-47c3-b5eb-6a560147dccd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103898) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:32:10.023832 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-390f71ec-4d6e-47c3-b5eb-6a560147dccd admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016249 Jul 12 17:32:10.023832 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1190 bytes} [Tue Jul 12 17:32:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 17:32:11.029438 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-0f280c73-b5ce-4257-be62-2fe05c5b35d9 admin admin] Calling method '>' {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:11.030489 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-0f280c73-b5ce-4257-be62-2fe05c5b35d9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 12 17:32:11.031030 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jul 12 17:32:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:32:11.587370 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-f228b54d-6977-471c-b2ea-a2de78b296ec admin admin] Calling method '>' {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:11.594336 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.wsgi [None req-f228b54d-6977-471c-b2ea-a2de78b296ec admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 12 17:32:11.596059 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-f228b54d-6977-471c-b2ea-a2de78b296ec admin admin] Request method failure captured: Jul 12 17:32:11.596059 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 12 17:32:11.596059 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: Accept: application/json Jul 12 17:32:11.596059 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: Accept-Encoding: gzip, deflate Jul 12 17:32:11.596059 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: Connection: keep-alive Jul 12 17:32:11.596059 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: Content-Length: 0 Jul 12 17:32:11.596059 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: Host: 10.222.0.16 Jul 12 17:32:11.596059 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: Openstack-Api-Version: compute 2.90 Jul 12 17:32:11.596059 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: Openstack-System-Scope: None Jul 12 17:32:11.596059 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: User-Agent: python-novaclient Jul 12 17:32:11.596059 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Auth-Token: gAAAAABizbAaaGzWJttTMC5dI03eh9RAnTAqq63LTOpAkwxvNwF05DWXPc-_5b1DkRUtEveB0x35KOWAg9PREO7ZD56JLYU1rMUnFajxUcNwrC8h5k96wMONHy_d2uDWLyEbCkZFRNXRlRiK9bC1H7sQb0tSCoHVNSKE-u3S7QeNPvhggPLAOFE Jul 12 17:32:11.596059 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Domain-Id: None Jul 12 17:32:11.596059 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Domain-Name: None Jul 12 17:32:11.596059 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Identity-Status: Confirmed Jul 12 17:32:11.596059 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Is-Admin-Project: True Jul 12 17:32:11.596059 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 17:32:11.596059 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Project-Domain-Id: default Jul 12 17:32:11.596059 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Project-Domain-Name: Default Jul 12 17:32:11.596059 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Project-Id: 1d1f69915b004b66af4c48b7c59a15d8 Jul 12 17:32:11.596059 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Project-Name: admin Jul 12 17:32:11.596059 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Role: admin,reader,member Jul 12 17:32:11.596059 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Roles: admin,reader,member Jul 12 17:32:11.597492 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d1f69915b004b66af4c48b7c59a15d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1d1f69915b004b66af4c48b7c59a15d8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d1f69915b004b66af4c48b7c59a15d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1d1f69915b004b66af4c48b7c59a15d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:32:11.597492 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Tenant: admin Jul 12 17:32:11.597492 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Tenant-Id: 1d1f69915b004b66af4c48b7c59a15d8 Jul 12 17:32:11.597492 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Tenant-Name: admin Jul 12 17:32:11.597492 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-User: admin Jul 12 17:32:11.597492 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-User-Domain-Id: default Jul 12 17:32:11.597492 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-User-Domain-Name: Default Jul 12 17:32:11.597492 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-User-Id: df85f597d0ba471381a5a8f9b6886705 Jul 12 17:32:11.597492 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-User-Name: admin Jul 12 17:32:11.597492 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: method: > Jul 12 17:32:11.597492 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: exception: Flavor 84 could not be found. Jul 12 17:32:11.597492 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: action_args: {'id': '84'} Jul 12 17:32:11.597492 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:32:11.597492 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:32:11.601600 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 17:32:11.601600 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 17:32:11.601600 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 17:32:11.601600 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 17:32:11.601600 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 17:32:11.601600 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 17:32:11.601600 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 17:32:11.601600 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 17:32:11.601600 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 17:32:11.601600 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:32:11.601600 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 17:32:11.601600 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 17:32:11.601600 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 12 17:32:11.601600 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi Jul 12 17:32:11.601600 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:32:11.601600 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi Jul 12 17:32:11.601600 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:32:11.601600 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:32:11.601600 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:32:11.602776 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:32:11.602776 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:32:11.602776 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:32:11.602776 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:32:11.602776 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 17:32:11.602776 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:32:11.602776 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 12 17:32:11.602776 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi Jul 12 17:32:11.602776 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:32:11.602776 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi Jul 12 17:32:11.602776 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:32:11.602776 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:32:11.602776 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:32:11.602776 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:32:11.602776 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:32:11.602776 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 12 17:32:11.602776 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi Jul 12 17:32:11.602776 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-f228b54d-6977-471c-b2ea-a2de78b296ec admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103898) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:32:11.603813 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-f228b54d-6977-471c-b2ea-a2de78b296ec admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.427754 Jul 12 17:32:11.603813 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1190 bytes} [Tue Jul 12 17:32:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 429 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 17:32:11.607267 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-125580a2-b009-4000-b09e-4801f5c0256d admin admin] Calling method '>' {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:11.621245 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-125580a2-b009-4000-b09e-4801f5c0256d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017541 Jul 12 17:32:11.621811 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1210 bytes} [Tue Jul 12 17:32:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:32:11.631861 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-5369fcc4-2b2f-4d33-bbd2-ddea96202946 admin admin] Calling method '>' {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:11.646509 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-5369fcc4-2b2f-4d33-bbd2-ddea96202946 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018289 Jul 12 17:32:11.647377 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1210 bytes} [Tue Jul 12 17:32:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:32:11.657515 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-9768ceaa-b318-4358-8f8c-54a491c46272 admin admin] Calling method '>' {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:11.663460 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.wsgi [None req-9768ceaa-b318-4358-8f8c-54a491c46272 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 12 17:32:11.664994 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-9768ceaa-b318-4358-8f8c-54a491c46272 admin admin] Request method failure captured: Jul 12 17:32:11.664994 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 12 17:32:11.664994 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: Accept: application/json Jul 12 17:32:11.664994 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: Accept-Encoding: gzip, deflate Jul 12 17:32:11.664994 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: Connection: keep-alive Jul 12 17:32:11.664994 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: Content-Length: 0 Jul 12 17:32:11.664994 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: Host: 10.222.0.16 Jul 12 17:32:11.664994 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: Openstack-Api-Version: compute 2.90 Jul 12 17:32:11.664994 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: Openstack-System-Scope: None Jul 12 17:32:11.664994 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: User-Agent: python-novaclient Jul 12 17:32:11.664994 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Auth-Token: gAAAAABizbAaaGzWJttTMC5dI03eh9RAnTAqq63LTOpAkwxvNwF05DWXPc-_5b1DkRUtEveB0x35KOWAg9PREO7ZD56JLYU1rMUnFajxUcNwrC8h5k96wMONHy_d2uDWLyEbCkZFRNXRlRiK9bC1H7sQb0tSCoHVNSKE-u3S7QeNPvhggPLAOFE Jul 12 17:32:11.664994 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Domain-Id: None Jul 12 17:32:11.664994 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Domain-Name: None Jul 12 17:32:11.664994 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Identity-Status: Confirmed Jul 12 17:32:11.664994 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Is-Admin-Project: True Jul 12 17:32:11.664994 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 17:32:11.664994 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Project-Domain-Id: default Jul 12 17:32:11.664994 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Project-Domain-Name: Default Jul 12 17:32:11.664994 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Project-Id: 1d1f69915b004b66af4c48b7c59a15d8 Jul 12 17:32:11.664994 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Project-Name: admin Jul 12 17:32:11.664994 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Role: admin,reader,member Jul 12 17:32:11.664994 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Roles: admin,reader,member Jul 12 17:32:11.666289 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d1f69915b004b66af4c48b7c59a15d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1d1f69915b004b66af4c48b7c59a15d8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d1f69915b004b66af4c48b7c59a15d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1d1f69915b004b66af4c48b7c59a15d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:32:11.666289 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Tenant: admin Jul 12 17:32:11.666289 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Tenant-Id: 1d1f69915b004b66af4c48b7c59a15d8 Jul 12 17:32:11.666289 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Tenant-Name: admin Jul 12 17:32:11.666289 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-User: admin Jul 12 17:32:11.666289 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-User-Domain-Id: default Jul 12 17:32:11.666289 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-User-Domain-Name: Default Jul 12 17:32:11.666289 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-User-Id: df85f597d0ba471381a5a8f9b6886705 Jul 12 17:32:11.666289 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-User-Name: admin Jul 12 17:32:11.666289 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: method: > Jul 12 17:32:11.666289 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: exception: Flavor 84 could not be found. Jul 12 17:32:11.666289 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: action_args: {'id': '84'} Jul 12 17:32:11.666289 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:32:11.666289 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:32:11.667157 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 17:32:11.667157 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 17:32:11.667157 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 17:32:11.667157 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 17:32:11.667157 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 17:32:11.667157 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 17:32:11.667157 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 17:32:11.667157 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 17:32:11.667157 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 17:32:11.667157 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:32:11.667157 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 17:32:11.667157 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 17:32:11.667157 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 12 17:32:11.667157 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi Jul 12 17:32:11.667157 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:32:11.667157 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi Jul 12 17:32:11.667157 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:32:11.667157 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:32:11.667157 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:32:11.668676 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:32:11.668676 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:32:11.668676 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:32:11.668676 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:32:11.668676 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 17:32:11.668676 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:32:11.668676 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 12 17:32:11.668676 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi Jul 12 17:32:11.668676 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:32:11.668676 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi Jul 12 17:32:11.668676 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:32:11.668676 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:32:11.668676 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:32:11.668676 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:32:11.668676 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:32:11.668676 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 12 17:32:11.668676 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi Jul 12 17:32:11.668676 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-9768ceaa-b318-4358-8f8c-54a491c46272 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:32:11.670051 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-9768ceaa-b318-4358-8f8c-54a491c46272 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013315 Jul 12 17:32:11.670051 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1190 bytes} [Tue Jul 12 17:32:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 12 17:32:12.677395 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-5369fcc4-2b2f-4d33-bbd2-ddea96202946 admin admin] Calling method '>' {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:12.678494 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-5369fcc4-2b2f-4d33-bbd2-ddea96202946 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jul 12 17:32:12.678894 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jul 12 17:32:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:32:13.248556 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-c3d6d9d4-f449-4b83-9443-5a32c70c18ea admin admin] Calling method '>' {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:13.255332 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.wsgi [None req-c3d6d9d4-f449-4b83-9443-5a32c70c18ea admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 12 17:32:13.256856 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-c3d6d9d4-f449-4b83-9443-5a32c70c18ea admin admin] Request method failure captured: Jul 12 17:32:13.256856 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 12 17:32:13.256856 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: Accept: application/json Jul 12 17:32:13.256856 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: Accept-Encoding: gzip, deflate Jul 12 17:32:13.256856 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: Connection: keep-alive Jul 12 17:32:13.256856 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: Content-Length: 0 Jul 12 17:32:13.256856 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: Host: 10.222.0.16 Jul 12 17:32:13.256856 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: Openstack-Api-Version: compute 2.90 Jul 12 17:32:13.256856 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: Openstack-System-Scope: None Jul 12 17:32:13.256856 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: User-Agent: python-novaclient Jul 12 17:32:13.256856 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Auth-Token: gAAAAABizbAcVG2ax30PFzNpVaPXDEEAhOBZPqnsPtlP4lBGGi3bFnj7jqv74q_vH5wWpitaKfO_iGLiLVEzjUA-wyigsUJllzHecfp5Y4-oQuCqmTV8TwCSWewbJFx9H3BNEgiARogX-lN4_vjpIA2qeaANF1Git4_073-tdgSvRW618cwId-8 Jul 12 17:32:13.256856 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Domain-Id: None Jul 12 17:32:13.256856 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Domain-Name: None Jul 12 17:32:13.256856 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Identity-Status: Confirmed Jul 12 17:32:13.256856 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Is-Admin-Project: True Jul 12 17:32:13.256856 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 17:32:13.256856 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Project-Domain-Id: default Jul 12 17:32:13.256856 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Project-Domain-Name: Default Jul 12 17:32:13.256856 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Project-Id: 1d1f69915b004b66af4c48b7c59a15d8 Jul 12 17:32:13.256856 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Project-Name: admin Jul 12 17:32:13.256856 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Role: admin,reader,member Jul 12 17:32:13.256856 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Roles: admin,reader,member Jul 12 17:32:13.258339 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d1f69915b004b66af4c48b7c59a15d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1d1f69915b004b66af4c48b7c59a15d8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d1f69915b004b66af4c48b7c59a15d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1d1f69915b004b66af4c48b7c59a15d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:32:13.258339 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Tenant: admin Jul 12 17:32:13.258339 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Tenant-Id: 1d1f69915b004b66af4c48b7c59a15d8 Jul 12 17:32:13.258339 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-Tenant-Name: admin Jul 12 17:32:13.258339 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-User: admin Jul 12 17:32:13.258339 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-User-Domain-Id: default Jul 12 17:32:13.258339 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-User-Domain-Name: Default Jul 12 17:32:13.258339 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-User-Id: df85f597d0ba471381a5a8f9b6886705 Jul 12 17:32:13.258339 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: X-User-Name: admin Jul 12 17:32:13.258339 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: method: > Jul 12 17:32:13.258339 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: exception: Flavor 451 could not be found. Jul 12 17:32:13.258339 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: action_args: {'id': '451'} Jul 12 17:32:13.258339 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:32:13.258339 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:32:13.259309 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 17:32:13.259309 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 17:32:13.259309 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 17:32:13.259309 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 17:32:13.259309 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 17:32:13.259309 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 17:32:13.259309 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 17:32:13.259309 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 17:32:13.259309 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 17:32:13.259309 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:32:13.259309 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 17:32:13.259309 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 17:32:13.259309 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 12 17:32:13.259309 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi Jul 12 17:32:13.259309 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:32:13.259309 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi Jul 12 17:32:13.259309 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:32:13.259309 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:32:13.259309 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:32:13.260376 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:32:13.260376 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:32:13.260376 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:32:13.260376 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:32:13.260376 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 17:32:13.260376 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:32:13.260376 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 12 17:32:13.260376 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi Jul 12 17:32:13.260376 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:32:13.260376 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi Jul 12 17:32:13.260376 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:32:13.260376 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:32:13.260376 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:32:13.260376 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:32:13.260376 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:32:13.260376 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 12 17:32:13.260376 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: ERROR nova.api.openstack.wsgi Jul 12 17:32:13.260376 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-c3d6d9d4-f449-4b83-9443-5a32c70c18ea admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:32:13.261419 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-c3d6d9d4-f449-4b83-9443-5a32c70c18ea admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.438130 Jul 12 17:32:13.261950 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1193 bytes} [Tue Jul 12 17:32:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 442 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 17:32:13.269091 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-9086cb3f-a596-4c42-a881-eddd08221d46 admin admin] Calling method '>' {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:13.283669 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-9086cb3f-a596-4c42-a881-eddd08221d46 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019127 Jul 12 17:32:13.284256 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1210 bytes} [Tue Jul 12 17:32:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:32:13.293998 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-40b543e5-a9b1-4eb7-a78d-1d9e2c000cd1 admin admin] Calling method '>' {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:13.310090 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-40b543e5-a9b1-4eb7-a78d-1d9e2c000cd1 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019614 Jul 12 17:32:13.310674 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1210 bytes} [Tue Jul 12 17:32:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:32:13.320794 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-e500addc-ccc0-49be-9b80-80b1fe876a48 admin admin] Calling method '>' {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:13.326315 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.wsgi [None req-e500addc-ccc0-49be-9b80-80b1fe876a48 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 12 17:32:13.327879 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-e500addc-ccc0-49be-9b80-80b1fe876a48 admin admin] Request method failure captured: Jul 12 17:32:13.327879 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 12 17:32:13.327879 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: Accept: application/json Jul 12 17:32:13.327879 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: Accept-Encoding: gzip, deflate Jul 12 17:32:13.327879 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: Connection: keep-alive Jul 12 17:32:13.327879 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: Content-Length: 0 Jul 12 17:32:13.327879 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: Host: 10.222.0.16 Jul 12 17:32:13.327879 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: Openstack-Api-Version: compute 2.90 Jul 12 17:32:13.327879 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: Openstack-System-Scope: None Jul 12 17:32:13.327879 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: User-Agent: python-novaclient Jul 12 17:32:13.327879 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Auth-Token: gAAAAABizbAcVG2ax30PFzNpVaPXDEEAhOBZPqnsPtlP4lBGGi3bFnj7jqv74q_vH5wWpitaKfO_iGLiLVEzjUA-wyigsUJllzHecfp5Y4-oQuCqmTV8TwCSWewbJFx9H3BNEgiARogX-lN4_vjpIA2qeaANF1Git4_073-tdgSvRW618cwId-8 Jul 12 17:32:13.327879 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Domain-Id: None Jul 12 17:32:13.327879 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Domain-Name: None Jul 12 17:32:13.327879 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Identity-Status: Confirmed Jul 12 17:32:13.327879 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Is-Admin-Project: True Jul 12 17:32:13.327879 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 17:32:13.327879 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Project-Domain-Id: default Jul 12 17:32:13.327879 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Project-Domain-Name: Default Jul 12 17:32:13.327879 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Project-Id: 1d1f69915b004b66af4c48b7c59a15d8 Jul 12 17:32:13.327879 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Project-Name: admin Jul 12 17:32:13.327879 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Role: admin,reader,member Jul 12 17:32:13.327879 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Roles: admin,reader,member Jul 12 17:32:13.329903 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d1f69915b004b66af4c48b7c59a15d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1d1f69915b004b66af4c48b7c59a15d8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d1f69915b004b66af4c48b7c59a15d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1d1f69915b004b66af4c48b7c59a15d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:32:13.329903 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Tenant: admin Jul 12 17:32:13.329903 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Tenant-Id: 1d1f69915b004b66af4c48b7c59a15d8 Jul 12 17:32:13.329903 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-Tenant-Name: admin Jul 12 17:32:13.329903 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-User: admin Jul 12 17:32:13.329903 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-User-Domain-Id: default Jul 12 17:32:13.329903 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-User-Domain-Name: Default Jul 12 17:32:13.329903 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-User-Id: df85f597d0ba471381a5a8f9b6886705 Jul 12 17:32:13.329903 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: X-User-Name: admin Jul 12 17:32:13.329903 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: method: > Jul 12 17:32:13.329903 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: exception: Flavor 451 could not be found. Jul 12 17:32:13.329903 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: action_args: {'id': '451'} Jul 12 17:32:13.329903 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:32:13.329903 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:32:13.332292 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 17:32:13.332292 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 17:32:13.332292 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 17:32:13.332292 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 17:32:13.332292 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 17:32:13.332292 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 17:32:13.332292 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 17:32:13.332292 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 17:32:13.332292 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 17:32:13.332292 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:32:13.332292 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 17:32:13.332292 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 17:32:13.332292 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 12 17:32:13.332292 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi Jul 12 17:32:13.332292 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:32:13.332292 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi Jul 12 17:32:13.332292 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:32:13.332292 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:32:13.332292 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:32:13.333616 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:32:13.333616 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:32:13.333616 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:32:13.333616 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:32:13.333616 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 17:32:13.333616 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:32:13.333616 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 12 17:32:13.333616 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi Jul 12 17:32:13.333616 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:32:13.333616 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi Jul 12 17:32:13.333616 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:32:13.333616 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:32:13.333616 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:32:13.333616 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:32:13.333616 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:32:13.333616 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 12 17:32:13.333616 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: ERROR nova.api.openstack.wsgi Jul 12 17:32:13.333616 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-e500addc-ccc0-49be-9b80-80b1fe876a48 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103898) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:32:13.334933 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-e500addc-ccc0-49be-9b80-80b1fe876a48 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012641 Jul 12 17:32:13.334933 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1193 bytes} [Tue Jul 12 17:32:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 17:32:14.326332 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-40b543e5-a9b1-4eb7-a78d-1d9e2c000cd1 admin admin] Calling method '>' {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:14.327510 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-40b543e5-a9b1-4eb7-a78d-1d9e2c000cd1 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Jul 12 17:32:14.328172 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jul 12 17:32:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:32:14.883799 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-89c596a0-7a21-4a85-9638-f00988933d23 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:32:14.966293 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-89c596a0-7a21-4a85-9638-f00988933d23 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.500079 Jul 12 17:32:14.967406 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1235 bytes} [Tue Jul 12 17:32:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:32:15.954269 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-40b543e5-a9b1-4eb7-a78d-1d9e2c000cd1 admin admin] Calling method '>' {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:15.954269 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-40b543e5-a9b1-4eb7-a78d-1d9e2c000cd1 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jul 12 17:32:15.954269 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jul 12 17:32:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:32:16.486158 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-d33a2e0c-6b27-4ef2-a96d-281422ca9bd7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:32:16.646139 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-d33a2e0c-6b27-4ef2-a96d-281422ca9bd7 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.551487 Jul 12 17:32:16.646656 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1235 bytes} [Tue Jul 12 17:32:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 17:32:17.643915 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-40b543e5-a9b1-4eb7-a78d-1d9e2c000cd1 admin admin] Calling method '>' {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:17.645132 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-40b543e5-a9b1-4eb7-a78d-1d9e2c000cd1 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Jul 12 17:32:17.645599 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jul 12 17:32:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:32:18.173853 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-160b257e-bfba-493d-821e-4b41161b9afd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:32:18.268154 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-160b257e-bfba-493d-821e-4b41161b9afd admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.482491 Jul 12 17:32:18.268705 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1235 bytes} [Tue Jul 12 17:32:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:32:19.245036 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-40b543e5-a9b1-4eb7-a78d-1d9e2c000cd1 admin admin] Calling method '>' {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:19.246087 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-40b543e5-a9b1-4eb7-a78d-1d9e2c000cd1 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 12 17:32:19.246648 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jul 12 17:32:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:32:19.787655 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-d483083e-399e-42af-8f80-8d5144747923 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:32:19.867663 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-d483083e-399e-42af-8f80-8d5144747923 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.475445 Jul 12 17:32:19.868214 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1235 bytes} [Tue Jul 12 17:32:19 2022] POST /compute/v2.1/flavors => generated 409 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:32:20.846377 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-40b543e5-a9b1-4eb7-a78d-1d9e2c000cd1 admin admin] Calling method '>' {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:20.847415 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-40b543e5-a9b1-4eb7-a78d-1d9e2c000cd1 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jul 12 17:32:20.847814 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jul 12 17:32:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:32:21.370635 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-4c9d0fbf-4f22-41ad-b283-b5079ea72cb1 admin admin] Calling method '>' {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:21.389394 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-4c9d0fbf-4f22-41ad-b283-b5079ea72cb1 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.403634 Jul 12 17:32:21.389941 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1202 bytes} [Tue Jul 12 17:32:20 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:33:14.254682 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-40b543e5-a9b1-4eb7-a78d-1d9e2c000cd1 admin admin] Calling method '>' {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:14.255656 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-40b543e5-a9b1-4eb7-a78d-1d9e2c000cd1 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jul 12 17:33:14.256075 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jul 12 17:33:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:33:14.267733 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG dbcounter [-] [103898] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:14.652429 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-a7802e90-8193-4e77-a97d-6fa7e3692c24 admin admin] Calling method '>' {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:14.672482 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-a7802e90-8193-4e77-a97d-6fa7e3692c24 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.410072 Jul 12 17:33:14.673029 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1291 bytes} [Tue Jul 12 17:33:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:33:14.693368 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG dbcounter [-] [103897] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:14.697059 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-61ff9533-5725-47e2-8281-94bc0c11f0d9 admin admin] Calling method '>' {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:14.706343 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-61ff9533-5725-47e2-8281-94bc0c11f0d9 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014381 Jul 12 17:33:14.708055 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1282 bytes} [Tue Jul 12 17:33:14 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:14.719799 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-afbfa04d-872b-4d87-b394-fdc23d4998d7 admin admin] Calling method '>' {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:14.727577 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-afbfa04d-872b-4d87-b394-fdc23d4998d7 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012546 Jul 12 17:33:14.728100 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1285 bytes} [Tue Jul 12 17:33:14 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:14.739870 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-bb0fe0fa-9c39-4265-bc04-9683800e07d6 admin admin] Calling method '>' {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:14.747736 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-bb0fe0fa-9c39-4265-bc04-9683800e07d6 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011502 Jul 12 17:33:14.748267 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1285 bytes} [Tue Jul 12 17:33:14 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:14.759770 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-6e959af5-b29e-45af-8fdd-dd621c1a27e5 admin admin] Calling method '>' {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:14.768240 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-6e959af5-b29e-45af-8fdd-dd621c1a27e5 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012055 Jul 12 17:33:14.768768 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1282 bytes} [Tue Jul 12 17:33:14 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:55.979744 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-bb0fe0fa-9c39-4265-bc04-9683800e07d6 admin admin] Calling method '>' {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:55.980766 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-bb0fe0fa-9c39-4265-bc04-9683800e07d6 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 12 17:36:55.981164 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 34/69] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jul 12 17:36:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:36:56.126200 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG dbcounter [-] [103898] Writing DB stats nova_api:SELECT=6 {{(pid=103898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:36:56.293880 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-5d3ad14b-fe86-42f7-9766-cce320ced9e8 admin admin] Calling method '>' {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:56.296180 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 17:36:56.296180 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: warnings.warn(msg) Jul 12 17:36:56.298342 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG oslo_concurrency.lockutils [None req-5d3ad14b-fe86-42f7-9766-cce320ced9e8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:56.299134 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG oslo_concurrency.lockutils [None req-5d3ad14b-fe86-42f7-9766-cce320ced9e8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:56.301965 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG oslo_concurrency.lockutils [None req-5d3ad14b-fe86-42f7-9766-cce320ced9e8 admin admin] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:56.302783 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG oslo_concurrency.lockutils [None req-5d3ad14b-fe86-42f7-9766-cce320ced9e8 admin admin] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:56.349740 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-5d3ad14b-fe86-42f7-9766-cce320ced9e8 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.225007 Jul 12 17:36:56.350307 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 36/70] 10.222.0.16 () {60 vars in 1193 bytes} [Tue Jul 12 17:36:56 2022] GET /compute/v2.1/os-services => generated 791 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:36:57.220962 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-bb0fe0fa-9c39-4265-bc04-9683800e07d6 admin admin] Calling method '>' {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:57.221980 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-bb0fe0fa-9c39-4265-bc04-9683800e07d6 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 12 17:36:57.222386 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 35/71] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jul 12 17:36:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:36:57.421026 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-ec6df6d0-b309-41da-a9b3-09a725c97136 admin admin] Calling method '>' {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:57.422216 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 17:36:57.422216 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: warnings.warn(msg) Jul 12 17:36:57.423448 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG oslo_concurrency.lockutils [None req-ec6df6d0-b309-41da-a9b3-09a725c97136 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:57.423886 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG oslo_concurrency.lockutils [None req-ec6df6d0-b309-41da-a9b3-09a725c97136 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:57.424672 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG oslo_concurrency.lockutils [None req-ec6df6d0-b309-41da-a9b3-09a725c97136 admin admin] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:57.425086 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG oslo_concurrency.lockutils [None req-ec6df6d0-b309-41da-a9b3-09a725c97136 admin admin] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:57.444987 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-ec6df6d0-b309-41da-a9b3-09a725c97136 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076779 Jul 12 17:36:57.445471 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 37/72] 10.222.0.16 () {60 vars in 1193 bytes} [Tue Jul 12 17:36:57 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:37:08.818336 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-bb0fe0fa-9c39-4265-bc04-9683800e07d6 admin admin] Calling method '>' {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:08.819472 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-bb0fe0fa-9c39-4265-bc04-9683800e07d6 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001614 Jul 12 17:37:08.820066 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 36/73] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jul 12 17:37:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:37:08.974084 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG dbcounter [-] [103898] Writing DB stats nova_cell0:SELECT=4 {{(pid=103898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:37:08.975596 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG dbcounter [-] [103898] Writing DB stats nova_cell1:SELECT=4 {{(pid=103898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:37:08.976513 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG dbcounter [-] [103898] Writing DB stats nova_api:SELECT=8 {{(pid=103898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:37:09.037106 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-ee31d074-567c-409f-bf9f-919d453fe85a admin admin] Calling method '>' {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:09.039391 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 17:37:09.039391 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: warnings.warn(msg) Jul 12 17:37:09.041706 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG oslo_concurrency.lockutils [None req-ee31d074-567c-409f-bf9f-919d453fe85a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:09.042734 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG oslo_concurrency.lockutils [None req-ee31d074-567c-409f-bf9f-919d453fe85a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:09.045149 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG oslo_concurrency.lockutils [None req-ee31d074-567c-409f-bf9f-919d453fe85a admin admin] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:09.046054 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG oslo_concurrency.lockutils [None req-ee31d074-567c-409f-bf9f-919d453fe85a admin admin] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:09.105406 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-ee31d074-567c-409f-bf9f-919d453fe85a admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.137204 Jul 12 17:37:09.106495 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 38/74] 10.222.0.16 () {60 vars in 1193 bytes} [Tue Jul 12 17:37:08 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:37:10.080407 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: DEBUG nova.api.openstack.wsgi [None req-bb0fe0fa-9c39-4265-bc04-9683800e07d6 admin admin] Calling method '>' {{(pid=103897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:10.081878 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: INFO nova.api.openstack.requestlog [None req-bb0fe0fa-9c39-4265-bc04-9683800e07d6 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002553 Jul 12 17:37:10.082409 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: [pid: 103897|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jul 12 17:37:10 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:37:10.300865 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG nova.api.openstack.wsgi [None req-a1466fa3-9082-42f8-a6b8-2e83cf11edae admin admin] Calling method '>' {{(pid=103898) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:10.302107 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 17:37:10.302107 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: warnings.warn(msg) Jul 12 17:37:10.303434 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG oslo_concurrency.lockutils [None req-a1466fa3-9082-42f8-a6b8-2e83cf11edae admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:10.303879 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG oslo_concurrency.lockutils [None req-a1466fa3-9082-42f8-a6b8-2e83cf11edae admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:10.304740 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG oslo_concurrency.lockutils [None req-a1466fa3-9082-42f8-a6b8-2e83cf11edae admin admin] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:10.305176 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: DEBUG oslo_concurrency.lockutils [None req-a1466fa3-9082-42f8-a6b8-2e83cf11edae admin admin] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103898) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:10.329875 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: INFO nova.api.openstack.requestlog [None req-a1466fa3-9082-42f8-a6b8-2e83cf11edae admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.089980 Jul 12 17:37:10.330484 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: [pid: 103898|app: 0|req: 39/76] 10.222.0.16 () {60 vars in 1193 bytes} [Tue Jul 12 17:37:10 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:38:07.929956 dv-cinder-848759-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 12 17:38:07.930573 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: Tue Jul 12 17:38:07 2022 - graceful shutdown triggered... Jul 12 17:38:07.931020 dv-cinder-848759-2-iscsi devstack@n-api.service[103898]: Gracefully killing worker 2 (pid: 103898)... Jul 12 17:38:07.931396 dv-cinder-848759-2-iscsi devstack@n-api.service[103897]: Gracefully killing worker 1 (pid: 103897)... Jul 12 17:38:08.931262 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: worker 1 buried after 1 seconds Jul 12 17:38:08.931262 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: worker 2 buried after 1 seconds Jul 12 17:38:08.931262 dv-cinder-848759-2-iscsi devstack@n-api.service[103896]: goodbye to uWSGI. Jul 12 17:38:08.932844 dv-cinder-848759-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 12 17:38:08.933429 dv-cinder-848759-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 12 17:38:08.936294 dv-cinder-848759-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 12 17:38:08.946703 dv-cinder-848759-2-iscsi devstack@n-api.service[130035]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 12 17:38:08.949099 dv-cinder-848759-2-iscsi devstack@n-api.service[130035]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 17:38:08 2022] *** Jul 12 17:38:08.949099 dv-cinder-848759-2-iscsi devstack@n-api.service[130035]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 17:38:08.949099 dv-cinder-848759-2-iscsi devstack@n-api.service[130035]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 17:38:08.949099 dv-cinder-848759-2-iscsi devstack@n-api.service[130035]: nodename: dv-cinder-848759-2-iscsi Jul 12 17:38:08.949099 dv-cinder-848759-2-iscsi devstack@n-api.service[130035]: machine: x86_64 Jul 12 17:38:08.949099 dv-cinder-848759-2-iscsi devstack@n-api.service[130035]: clock source: unix Jul 12 17:38:08.949099 dv-cinder-848759-2-iscsi devstack@n-api.service[130035]: pcre jit disabled Jul 12 17:38:08.949099 dv-cinder-848759-2-iscsi devstack@n-api.service[130035]: detected number of CPU cores: 4 Jul 12 17:38:08.949099 dv-cinder-848759-2-iscsi devstack@n-api.service[130035]: current working directory: / Jul 12 17:38:08.949099 dv-cinder-848759-2-iscsi devstack@n-api.service[130035]: detected binary path: /usr/bin/uwsgi-core Jul 12 17:38:08.949099 dv-cinder-848759-2-iscsi devstack@n-api.service[130035]: your processes number limit is 47680 Jul 12 17:38:08.949827 dv-cinder-848759-2-iscsi devstack@n-api.service[130035]: your memory page size is 4096 bytes Jul 12 17:38:08.949827 dv-cinder-848759-2-iscsi devstack@n-api.service[130035]: detected max file descriptor number: 2048 Jul 12 17:38:08.949827 dv-cinder-848759-2-iscsi devstack@n-api.service[130035]: lock engine: pthread robust mutexes Jul 12 17:38:08.949827 dv-cinder-848759-2-iscsi devstack@n-api.service[130035]: thunder lock: enabled Jul 12 17:38:08.949827 dv-cinder-848759-2-iscsi devstack@n-api.service[130035]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 12 17:38:08.949827 dv-cinder-848759-2-iscsi devstack@n-api.service[130035]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 17:38:08.994936 dv-cinder-848759-2-iscsi devstack@n-api.service[130035]: Python main interpreter initialized at 0x56156b4a19c0 Jul 12 17:38:08.994936 dv-cinder-848759-2-iscsi devstack@n-api.service[130035]: python threads support enabled Jul 12 17:38:08.994936 dv-cinder-848759-2-iscsi devstack@n-api.service[130035]: your server socket listen backlog is limited to 100 connections Jul 12 17:38:08.994936 dv-cinder-848759-2-iscsi devstack@n-api.service[130035]: your mercy for graceful operations on workers is 90 seconds Jul 12 17:38:08.995337 dv-cinder-848759-2-iscsi devstack@n-api.service[130035]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 17:38:08.995409 dv-cinder-848759-2-iscsi devstack@n-api.service[130035]: *** Operational MODE: preforking *** Jul 12 17:38:08.995701 dv-cinder-848759-2-iscsi devstack@n-api.service[130035]: *** uWSGI is running in multiple interpreter mode *** Jul 12 17:38:08.995701 dv-cinder-848759-2-iscsi devstack@n-api.service[130035]: spawned uWSGI master process (pid: 130035) Jul 12 17:38:08.995912 dv-cinder-848759-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 12 17:38:09.012811 dv-cinder-848759-2-iscsi devstack@n-api.service[130035]: spawned uWSGI worker 1 (pid: 130058, cores: 1) Jul 12 17:38:09.012811 dv-cinder-848759-2-iscsi devstack@n-api.service[130035]: spawned uWSGI worker 2 (pid: 130059, cores: 1) Jul 12 17:38:09.012811 dv-cinder-848759-2-iscsi devstack@n-api.service[130035]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 17:38:09.690995 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 17:38:09.696485 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 17:38:10.914099 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 17:38:10.914099 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: from cryptography.utils import int_from_bytes Jul 12 17:38:10.914757 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 17:38:10.914757 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: from cryptography.utils import int_from_bytes Jul 12 17:38:10.932404 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 17:38:10.932404 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: from cryptography.utils import int_from_bytes Jul 12 17:38:10.933120 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 17:38:10.933120 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: from cryptography.utils import int_from_bytes Jul 12 17:38:13.299567 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 17:38:13.300140 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 17:38:13.300370 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 17:38:13.301266 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 17:38:13.301530 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 17:38:13.301932 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.302401 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.302779 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.303109 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.303453 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.303774 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.304107 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.304441 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.304779 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.305048 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.305377 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.305714 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848759-2-iscsi {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.306046 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.306495 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.306827 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.307174 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.307488 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.307824 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.308181 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.308690 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.311206 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.311206 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.311206 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.311206 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.311850 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 17:38:13.312444 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.312532 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 17:38:13.312615 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.312721 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 17:38:13.312808 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.312808 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.312956 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 17:38:13.312956 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 17:38:13.313086 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.313086 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.314696 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.314696 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.315181 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848759-2-iscsi {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.315393 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.315557 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.315709 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.315872 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.316815 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.317039 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.317221 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.317394 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.317556 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.317733 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.317888 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.318052 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.318196 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.318341 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.318775 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.318930 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.319153 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.319319 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.319483 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848759-2-iscsi {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.319645 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.319815 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.319970 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.320138 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.320296 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.320433 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.320590 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.320764 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.320922 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.321059 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.321186 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.321319 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.321466 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.321616 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.321766 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.321766 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.322060 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.322254 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.323041 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.323203 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.323365 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.323529 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.323692 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.323917 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.324142 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.324308 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.324468 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.324628 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.324792 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.324940 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.325098 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.325257 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.325417 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.325575 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.325728 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.325893 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.326056 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.326220 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.326369 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848759-2-iscsi {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.326566 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.326731 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.326882 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.327040 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.327292 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.327463 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.327622 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.327851 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.328017 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.328167 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.328315 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.328463 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.328624 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.328775 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.328925 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.329096 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.329255 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.329405 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.329577 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.329739 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.329852 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.329946 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.330044 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.330139 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.330139 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.330312 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.330312 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.330644 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.330733 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.330820 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.330820 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.331000 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.331093 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.331186 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.331273 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.331371 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.331466 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.331659 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.331803 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.331917 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.332059 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.332203 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.332323 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.332459 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.332623 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.332793 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.332945 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.333110 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.333221 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.333221 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.333398 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.333492 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.333604 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.333701 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.333788 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.333872 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.333956 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.334041 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.334134 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.334222 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.334314 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.334408 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.334408 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.334612 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.334850 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.334989 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.335105 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.335219 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.335324 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.335428 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.335526 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.335619 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.335717 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.335863 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.335958 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.336051 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.336126 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.336204 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.336291 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.336382 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.336382 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.336559 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.336559 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.336729 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.336729 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.336903 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.336996 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.337095 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.337188 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.337475 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.337600 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.337705 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.337957 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.338079 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.338211 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.338332 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.338546 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.338681 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.338811 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.338811 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.339033 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.339163 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.339280 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.339399 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.339399 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.339671 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.339876 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.340049 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.340199 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.340352 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.340522 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.340745 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.340919 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.341073 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.341948 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.342171 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.342347 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.342525 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.342673 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.342830 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.342985 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.343137 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.343327 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.343484 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.343659 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.343814 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.343814 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.344108 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.344300 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.344507 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.344830 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.345098 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.345284 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.345507 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.345734 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.345919 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.346089 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.346259 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.346412 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.346595 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.346741 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.346923 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.347160 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.347405 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.347589 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.347796 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.348017 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.348268 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.348520 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.348748 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.348945 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.349123 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.349304 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.349522 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.349672 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.349820 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.349820 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.350176 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.350331 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.350607 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.350762 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.350964 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.351155 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.351303 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.351459 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.351624 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.351780 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.351992 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.352196 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.352352 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.352506 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.352651 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.352803 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.352965 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.353111 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.353255 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.353404 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.353562 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.353707 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.353866 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.354021 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.354172 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.354318 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.354318 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.354781 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.354939 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.355103 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.355344 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.355499 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.355682 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.355871 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.356055 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.356241 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.356395 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.356540 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.356684 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.356842 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.356995 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.357148 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.357301 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.357458 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.357612 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.357766 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.357923 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.358074 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.358237 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.358237 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.358559 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.358721 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.358883 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.359045 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:38:13.359200 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.359200 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.359575 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.359734 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.359909 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.360056 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.360229 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.360385 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.360577 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.360734 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.360888 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.361043 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.361205 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.361359 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.361549 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.361738 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.361901 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.362068 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.362068 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.362353 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.362623 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.362623 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.362919 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.363573 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.363573 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.363951 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.364196 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.364453 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.364712 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.364712 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.365024 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.365170 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.365170 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.365616 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.365769 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.365769 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.366051 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.366197 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.366197 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.366519 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.366670 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.366670 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.366994 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.367147 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.367147 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.367431 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.367584 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.367729 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.367872 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.367872 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.367872 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.368297 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.368450 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.368603 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.368747 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.368747 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.369074 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.369218 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.369218 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.369505 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.369662 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.369662 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.369947 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.370099 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.370099 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.370385 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.370563 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.370563 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.370881 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.371059 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.371059 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.371331 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.371475 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.371475 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.371770 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.371921 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.372091 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.372350 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.372527 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.372695 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.372865 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.373025 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.373355 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.373517 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.373757 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.373919 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.374082 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.374320 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.374556 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.374713 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.375094 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.375394 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.375581 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.375849 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.376052 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.376214 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.376381 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.376581 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.376750 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.376903 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.377098 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.377261 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.377512 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.377670 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.377829 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.378084 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.378284 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.378468 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.379586 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.379746 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.379892 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.380063 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.380297 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.380511 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.380511 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.380796 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.380949 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.381108 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.381292 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.381420 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.381534 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.381655 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.381770 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.381889 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.382020 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.382146 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.382305 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.382452 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.382571 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.382683 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.383787 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.383967 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.384125 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.384279 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.384466 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.384615 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.384833 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.384996 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.385143 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.385295 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.385442 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.385588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.385779 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.386050 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.386201 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.386357 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.386710 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.386871 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.387055 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.387203 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.387348 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.387493 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.387659 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.387840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.388003 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.388206 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.388356 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.388513 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.388657 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.388814 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.388814 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.389111 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.389302 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.389449 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.389606 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.389761 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.389931 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.390098 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.390250 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.390400 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.390661 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.390833 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.390993 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.391144 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.391307 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.391466 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.391625 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.391788 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.391947 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.392098 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.392256 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.392407 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.392559 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.392739 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.392899 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.393059 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.393217 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.393376 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.393536 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.393696 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.393854 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.394006 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.394191 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.394545 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.394819 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.395082 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.395431 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.395632 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.395796 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.395949 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.396224 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.396382 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.396533 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.396684 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.396834 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.396992 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.397153 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.397313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.397483 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.397644 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.397802 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.397970 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.398122 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.398281 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.398458 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.398458 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.398761 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.398968 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.399130 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.399289 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.399448 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.399617 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.399776 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.399936 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.400088 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.400239 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.400449 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.400646 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.400820 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.400985 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.401146 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.401297 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.401454 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.401614 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.401791 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.401951 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.402102 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.402252 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.402402 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.402575 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.402743 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.402937 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.403092 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.403250 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.403409 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.403583 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.403759 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.403931 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.404091 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.404316 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.404484 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.404484 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.404976 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.405130 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.405305 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.405458 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.405458 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.405804 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.405957 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.406108 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.406395 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.406665 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.406826 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.406993 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.407145 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.407296 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.407448 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.407599 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.407758 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.407996 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.408158 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.408317 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.408481 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.408639 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.408799 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.408965 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.409124 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.409282 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.409441 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.409600 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.409767 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.409990 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.410169 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.410411 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.418259 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.418560 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.418809 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.418983 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.419181 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.419347 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.419515 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.419680 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.419842 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.420003 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.420427 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.420600 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.420826 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.421098 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.421384 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.421669 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.421828 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.421987 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.422141 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.422299 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.422479 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.422648 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.422648 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.422648 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.423132 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.423308 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.423460 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.423623 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.423773 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.423923 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.424073 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.424235 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.424407 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.424694 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.424922 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.425080 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.425231 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.425899 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.426127 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.426375 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.426810 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.427043 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.427246 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.427414 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.427414 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.427711 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.427874 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.428074 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.428235 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.428386 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.428537 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.428687 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.428864 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.429023 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.429207 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.429369 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.429528 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.429703 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.429870 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.430029 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.430243 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.430398 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.430398 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.430745 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.430745 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.431075 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.431346 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.431608 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.431901 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.432069 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.432283 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.432450 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.432612 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.432771 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.432771 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.433097 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.433097 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.433385 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.433555 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.433709 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.433869 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.434021 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.434021 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.434378 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.434555 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.434725 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.434725 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.435154 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.435340 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.435496 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.435659 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.435812 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.435979 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.436139 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.436299 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.436503 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.436660 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.436924 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.437091 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.437250 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.437403 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.437562 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.437939 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.438127 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.438289 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.438491 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.438663 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.438816 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.438968 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.439128 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.439288 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.439440 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.439440 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.439735 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.439894 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.440059 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.440221 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.440221 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.440545 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.440709 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.440709 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.441028 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.441901 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.441901 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.442687 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.442891 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.443064 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.443227 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.443227 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.443539 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.443691 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.443691 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.444045 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.444201 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.444201 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.444489 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.444687 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.444687 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.445018 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.445336 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.445336 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.445653 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.445808 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.445808 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.446129 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.446292 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.446292 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.446292 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.446809 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.447117 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.447117 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.447426 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.447849 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.447849 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.448281 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.448444 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.448444 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.448788 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.448954 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.448954 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.449258 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.449423 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.449423 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.449796 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.449951 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.450103 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.450261 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.450486 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.450647 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.450647 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.450974 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.451125 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.451412 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.451578 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.451731 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.455921 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.455921 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.456978 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.457190 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.457190 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.457581 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.458092 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.458092 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.458325 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.458474 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.458474 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.464386 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.464822 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.464822 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.464994 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.465079 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.465079 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.465223 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.465295 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.465376 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.465459 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.465459 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.465638 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.465713 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.465713 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.465865 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.465941 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.465941 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.466079 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.466152 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.466224 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.466308 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.466308 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.467403 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.467560 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.467560 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.467560 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.468122 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.468282 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.468282 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.468617 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.468779 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.468779 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.469101 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.469264 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.469264 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.469553 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.469712 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.469712 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.470106 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.470266 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.470519 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.470711 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.470711 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.471085 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.471242 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.471242 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.471539 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.471699 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.471699 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.472015 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.472170 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.472170 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.473048 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.473281 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.473281 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.473790 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.473985 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.473985 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.474312 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.474484 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.474484 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.474809 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.474971 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.474971 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.475299 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.475453 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.475453 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.475769 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.476988 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.476988 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.477318 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.477481 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.477481 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.477805 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.478007 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.478007 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.478318 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.478521 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.478521 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.478850 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.479012 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.479214 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.479480 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.479480 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.479841 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.479999 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.479999 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.480304 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.480483 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.480483 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.480801 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.481000 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.481000 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.481296 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.481447 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.481447 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.481775 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.481927 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.481927 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.482214 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.482364 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.482556 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.482722 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.482722 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.483034 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.483187 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.483346 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.483512 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.483512 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.483810 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.483963 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.483963 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.484263 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.484417 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.484581 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.484733 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.484733 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.485029 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.485213 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.485213 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.485525 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.485678 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.485678 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.485980 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.487347 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.487347 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.487664 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.487845 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.488065 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.488732 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.488732 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.489211 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.489495 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.489495 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.490030 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.490235 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.490235 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.490597 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.490752 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.490913 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.491078 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.491078 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.491420 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.491573 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.491573 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.491877 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.492029 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.492029 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.492371 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.492528 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.492528 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.492824 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.493087 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.493271 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.493427 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.493427 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.493721 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.493874 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.493874 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.494180 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.494334 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.494540 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.494714 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.494714 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.495015 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.495175 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.495175 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.495487 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.495640 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.495640 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.495954 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.496107 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.496107 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.498023 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.498189 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.498189 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.498585 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.498758 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.498933 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.499095 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.499095 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.499411 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.499608 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.499608 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.500046 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.500213 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.500213 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.500518 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.500762 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.500762 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.501074 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.501248 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.501248 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.501548 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.501741 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.501895 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.502053 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.502053 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.502403 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.502580 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.502580 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.502882 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.503044 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.503044 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.503397 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.503587 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.503587 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.503896 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.504156 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.504156 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.504724 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.504898 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.504898 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.505206 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.505365 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.505365 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.505706 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.505885 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.505885 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.506178 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.506337 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.506337 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.506714 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.506875 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.506875 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.508152 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.508324 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.508324 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.508324 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.508680 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.508776 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.508872 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.508966 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.508966 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.509170 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.509273 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.509273 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.510311 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.510461 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.510461 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.510701 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.510824 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.510824 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.511055 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.511178 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.511178 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.511392 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.511506 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.511506 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.511739 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.511854 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.511854 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.512066 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.512187 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.512302 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.512430 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.512546 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.512660 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.512660 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.512896 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.513020 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.513020 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.513232 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.513345 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.513345 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.513563 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.513686 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.513686 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.513897 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.514050 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.514050 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.514598 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.514748 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.514882 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.515013 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.515013 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.515246 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.515362 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.515362 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.515592 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.515847 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.515847 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.516077 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.516207 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.516207 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.516441 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.516555 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.516686 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.516802 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.516802 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.517026 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.517148 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.517148 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.517739 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.518562 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.518562 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.518801 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.518914 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.519027 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.519139 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.519342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.519470 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.519671 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.519867 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.520073 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.520271 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.520521 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.520521 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.520756 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.520878 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.520994 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.521115 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.521243 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.521359 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.521481 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.521481 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.521693 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.521821 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.521936 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.522049 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.522172 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.522172 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.522381 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.522381 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.522649 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.522765 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.522880 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.522880 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.522880 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.522880 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.523322 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.523444 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.523559 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.523559 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.523784 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.523899 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.524022 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.524136 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.524249 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.524362 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.524489 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.524612 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.524727 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.524841 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.524841 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.525050 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.525243 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.525368 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.525489 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.525623 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.526305 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.526550 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.526702 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.526819 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.526948 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.527071 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.527192 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.527322 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.527457 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.527907 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.528637 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.528768 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.528885 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.529010 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.529135 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.529260 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.529375 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.529375 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.529597 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.529720 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.529837 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.529959 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.529959 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.530182 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.530297 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.530297 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.530664 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.530794 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.530909 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.531023 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.531023 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.531263 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.531385 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.531385 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.531609 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.531732 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.531732 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.531964 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.532087 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.532087 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.532310 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.532431 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.532431 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.532431 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.532771 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.532893 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.533007 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.533127 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.533127 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.533351 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.533464 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.533464 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.533683 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.533807 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.533807 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.534036 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.534151 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.534151 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.534379 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.534657 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.535307 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.535484 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.535484 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.535787 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.535986 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.535986 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.536363 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.536568 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.536568 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.536804 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.536927 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.536927 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.537165 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.537281 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.537281 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.537507 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.537631 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.538119 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.538867 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.538867 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.539105 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.539225 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.539361 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.539486 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.539486 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.539709 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.539824 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.539824 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.540054 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.540169 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.540283 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.540404 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.540404 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.540404 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.540860 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.540987 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.540987 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.541210 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.541324 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.541324 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.541553 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.541676 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.541676 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.541897 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.542018 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.542141 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.542256 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.542378 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.542565 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.542722 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.542846 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.542846 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.542846 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.543182 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.543303 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.543427 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.543551 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.543551 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.543782 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.543905 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.543905 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.544134 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.544273 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.544273 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.544501 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.544622 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.544622 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.544845 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.544968 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.544968 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.545181 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.545302 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.545302 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.545526 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.545650 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.545650 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.545906 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.546025 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.546025 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.546255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.546371 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.546506 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.546637 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.546637 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.546893 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.547038 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.547038 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.547362 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.547517 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.547517 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.547517 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.548381 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.549170 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.549357 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.549512 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.549512 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.549512 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.549983 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.550147 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.550308 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.550595 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.550595 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.550595 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.552030 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.552194 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.552355 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.552507 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.552507 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.552810 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.552984 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.552984 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.552984 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.553427 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.553581 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.553581 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.553893 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.554046 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.554198 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.554350 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.554350 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.554765 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.554920 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.554920 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.555229 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.555502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.555502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.555807 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.555958 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.555958 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.556245 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.556406 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.556406 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.556704 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.556862 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.556862 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.557170 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.557489 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.557489 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.557851 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.558015 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.558015 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.559400 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.559591 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.559591 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.559902 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.560065 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.560225 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.560391 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.560554 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.560706 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.560706 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.561005 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.561156 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.561326 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.561599 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.561599 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.561895 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.562057 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.562057 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.562352 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.570521 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.570521 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.571537 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.571859 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.571859 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.572455 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.572868 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.573063 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.573231 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.573231 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.573632 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.573825 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.573825 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.574136 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.574292 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.574292 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.574614 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.574780 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.574780 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.575085 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.575249 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.575249 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.575556 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.575725 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.575725 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.576035 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.576314 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.576489 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.576646 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.576646 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.576955 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.577108 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.577108 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.577417 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.577578 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.577578 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.577898 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.578052 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.578052 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.578559 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.578719 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.578719 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.586418 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.587194 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.587298 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.587390 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.587390 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.587571 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.587660 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.587660 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 17:38:13.587835 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.587835 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.587835 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.587835 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.587835 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.587835 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.587835 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.587835 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.588553 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.588553 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.588553 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.588553 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.588553 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.588553 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.588553 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.588553 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.589187 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.589187 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.589187 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.589187 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.589187 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.589187 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.589187 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.589187 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.589792 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.589792 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.589792 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.589792 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.589792 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.589792 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.590413 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.591139 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.591866 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.592619 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.593249 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.593835 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.594474 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.595102 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.595717 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.596339 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.596951 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.598775 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.599405 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.600046 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.600649 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.601269 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.601885 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.602569 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.603237 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.603872 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.604527 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.605149 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.605772 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.606884 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.607495 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.608134 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.608776 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.609406 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.610029 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.610682 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.611327 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.611931 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.612547 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.614733 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.615657 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.616316 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.616945 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.617612 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.618453 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.620248 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.620248 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.620759 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.621425 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.622043 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.622766 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.623691 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.624339 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.624951 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.625600 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.626175 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.627037 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.627659 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.628236 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.628868 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.629447 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.630049 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.630693 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.631266 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.631853 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.632432 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.633037 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.633607 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.634180 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.634858 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.635446 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.636040 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.636638 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.637277 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.637873 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.638523 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.639119 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.639722 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.640292 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.640855 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.641423 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.642010 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.642860 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.643472 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.644070 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.644667 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.645261 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.645895 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.646582 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.647197 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.647828 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.648513 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.649141 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.650176 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.650870 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.651503 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.652157 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.652805 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.653386 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.653971 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.654628 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.655169 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.655563 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.656073 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.656674 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.657268 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.657860 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.658518 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.659069 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.659660 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.660798 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.661390 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.662020 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.662620 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.663217 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.663817 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.664449 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.665017 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.665600 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.666233 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.666923 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.667500 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.668053 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.668653 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.669236 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.669850 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.670524 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.671131 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.671711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.672522 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.673108 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.673708 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.674293 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.674897 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.676131 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.676744 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.677203 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.677813 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.678408 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.679070 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.679720 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.680351 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.680958 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.681337 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.681741 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.682070 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.682404 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.682765 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.683131 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.683528 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.683850 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.684175 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.684523 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.684840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.685184 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.685495 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.685842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.686158 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.686545 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.686863 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.687174 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.687486 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.687863 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.688182 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.688536 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.688935 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.689211 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.689594 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.689830 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.690182 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.690587 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.690924 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.691783 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.692180 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.692511 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.693050 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.693372 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.693701 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.694030 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.694340 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.694712 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.695029 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.695356 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.695672 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.696073 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.696306 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.696619 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.696956 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.697287 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.697856 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.698190 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.698541 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.698867 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.699202 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.699525 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.699817 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.700135 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.700447 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.700773 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.701080 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.701393 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.701712 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.702029 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.702359 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.702723 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.703035 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.703368 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.703699 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.704050 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.704363 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.704712 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.705041 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.705360 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.705675 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.705982 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:38:13.706236 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 17:38:13.733077 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO dbcounter [None req-1e6ac7bb-211f-4e37-9232-cbb279f14214 None None] Registered counter for database nova_api Jul 12 17:38:13.756251 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_db.sqlalchemy.engines [None req-1e6ac7bb-211f-4e37-9232-cbb279f14214 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130058) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:38:13.764964 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writer thread running {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:38:13.826931 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.context [None req-1e6ac7bb-211f-4e37-9232-cbb279f14214 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3edbf35d-1b15-4b4d-a347-1a17c7474c01(cell1) {{(pid=130058) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 17:38:13.830965 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1e6ac7bb-211f-4e37-9232-cbb279f14214 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:13.833142 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1e6ac7bb-211f-4e37-9232-cbb279f14214 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:13.833985 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1e6ac7bb-211f-4e37-9232-cbb279f14214 None None] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:13.836039 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1e6ac7bb-211f-4e37-9232-cbb279f14214 None None] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:13.838063 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO dbcounter [None req-1e6ac7bb-211f-4e37-9232-cbb279f14214 None None] Registered counter for database nova_cell0 Jul 12 17:38:13.842320 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO dbcounter [None req-1e6ac7bb-211f-4e37-9232-cbb279f14214 None None] Registered counter for database nova_cell1 Jul 12 17:38:13.852416 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_db.sqlalchemy.engines [None req-1e6ac7bb-211f-4e37-9232-cbb279f14214 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130058) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:38:13.856957 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_db.sqlalchemy.engines [None req-1e6ac7bb-211f-4e37-9232-cbb279f14214 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130058) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:38:13.858739 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writer thread running {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:38:13.861588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO dbcounter [None req-41931ae1-793f-43cc-9e0c-0fd202cbdbec None None] Registered counter for database nova_api Jul 12 17:38:13.882205 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_db.sqlalchemy.engines [None req-41931ae1-793f-43cc-9e0c-0fd202cbdbec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130059) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:38:13.889622 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writer thread running {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:38:13.953091 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.context [None req-41931ae1-793f-43cc-9e0c-0fd202cbdbec None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3edbf35d-1b15-4b4d-a347-1a17c7474c01(cell1) {{(pid=130059) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 17:38:13.960134 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-41931ae1-793f-43cc-9e0c-0fd202cbdbec None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:13.963565 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-41931ae1-793f-43cc-9e0c-0fd202cbdbec None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:13.965028 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-41931ae1-793f-43cc-9e0c-0fd202cbdbec None None] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:13.968805 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-41931ae1-793f-43cc-9e0c-0fd202cbdbec None None] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:13.972562 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO dbcounter [None req-41931ae1-793f-43cc-9e0c-0fd202cbdbec None None] Registered counter for database nova_cell0 Jul 12 17:38:13.980197 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO dbcounter [None req-41931ae1-793f-43cc-9e0c-0fd202cbdbec None None] Registered counter for database nova_cell1 Jul 12 17:38:13.989388 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_db.sqlalchemy.engines [None req-41931ae1-793f-43cc-9e0c-0fd202cbdbec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130059) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:38:13.993118 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_db.sqlalchemy.engines [None req-41931ae1-793f-43cc-9e0c-0fd202cbdbec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130059) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:38:13.999784 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writer thread running {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:38:14.001088 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writer thread running {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:38:14.008472 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writer thread running {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:38:14.018080 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO dbcounter [None req-1e6ac7bb-211f-4e37-9232-cbb279f14214 None None] Registered counter for database nova_cell0 Jul 12 17:38:14.025160 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_db.sqlalchemy.engines [None req-1e6ac7bb-211f-4e37-9232-cbb279f14214 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130058) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:38:14.029859 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writer thread running {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:38:14.156835 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO dbcounter [None req-41931ae1-793f-43cc-9e0c-0fd202cbdbec None None] Registered counter for database nova_cell0 Jul 12 17:38:14.163775 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_db.sqlalchemy.engines [None req-41931ae1-793f-43cc-9e0c-0fd202cbdbec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130059) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:38:14.168461 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writer thread running {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:38:14.358206 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: WARNING keystonemiddleware.auth_token [None req-1e6ac7bb-211f-4e37-9232-cbb279f14214 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 17:38:14.366746 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: WARNING keystonemiddleware.auth_token [None req-1e6ac7bb-211f-4e37-9232-cbb279f14214 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 17:38:14.510804 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: WARNING keystonemiddleware.auth_token [None req-41931ae1-793f-43cc-9e0c-0fd202cbdbec None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 17:38:14.518513 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: WARNING keystonemiddleware.auth_token [None req-41931ae1-793f-43cc-9e0c-0fd202cbdbec None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 17:38:14.715097 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: WARNING keystonemiddleware.auth_token [None req-1e6ac7bb-211f-4e37-9232-cbb279f14214 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 17:38:14.721690 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: WARNING keystonemiddleware.auth_token [None req-1e6ac7bb-211f-4e37-9232-cbb279f14214 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 17:38:14.728163 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56156b4a19c0 pid: 130058 (default app) Jul 12 17:38:14.881872 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: WARNING keystonemiddleware.auth_token [None req-41931ae1-793f-43cc-9e0c-0fd202cbdbec None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 17:38:14.888093 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: WARNING keystonemiddleware.auth_token [None req-41931ae1-793f-43cc-9e0c-0fd202cbdbec None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 17:38:14.893676 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56156b4a19c0 pid: 130059 (default app) Jul 12 17:38:58.140153 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_api:SELECT=3 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:58.140153 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell0:SELECT=3 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:58.143249 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=3 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:58.143249 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell0:SELECT=3 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:59.804962 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-fba07f3f-699a-430f-8025-720084874eb0 tempest-VolumesGetTestJSON-1622099496 tempest-VolumesGetTestJSON-1622099496-project] Action: 'create', calling method: .version_select at 0x7f47adcf95e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2000687072", "metadata": {"Type": "work"}}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:39:02.409423 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-fba07f3f-699a-430f-8025-720084874eb0 tempest-VolumesGetTestJSON-1622099496 tempest-VolumesGetTestJSON-1622099496-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.137172 Jul 12 17:39:02.409423 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1155 bytes} [Tue Jul 12 17:38:58 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4139 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 12 17:39:03.049689 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-c158be2d-8686-421e-818d-77897cde462e tempest-VolumesGetTestJSON-1622099496 tempest-VolumesGetTestJSON-1622099496-project] Calling method '.version_select at 0x7f47adda91f0>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:03.120488 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_api:SELECT=3 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:39:03.121333 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=3 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:39:03.122224 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell0:SELECT=3 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:39:03.130927 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell0:SELECT=3 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:39:03.895898 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-c158be2d-8686-421e-818d-77897cde462e tempest-VolumesGetTestJSON-1622099496 tempest-VolumesGetTestJSON-1622099496-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9bda7d79-c247-43ce-a17c-e4bfa924d4d7" status: 200 len: 354 microversion: 2.1 time: 1.614940 Jul 12 17:39:03.896761 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 1/2] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jul 12 17:39:02 2022] GET /compute/v2.1/os-volumes/9bda7d79-c247-43ce-a17c-e4bfa924d4d7 => generated 354 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:39:03.918748 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-0bc6f364-1e5d-4d96-85b3-0c8d8575502b tempest-VolumesGetTestJSON-1622099496 tempest-VolumesGetTestJSON-1622099496-project] Calling method '.version_select at 0x7f47adbbf4c0>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:04.029272 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-0bc6f364-1e5d-4d96-85b3-0c8d8575502b tempest-VolumesGetTestJSON-1622099496 tempest-VolumesGetTestJSON-1622099496-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9bda7d79-c247-43ce-a17c-e4bfa924d4d7" status: 200 len: 354 microversion: 2.1 time: 0.123926 Jul 12 17:39:04.030303 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jul 12 17:39:03 2022] GET /compute/v2.1/os-volumes/9bda7d79-c247-43ce-a17c-e4bfa924d4d7 => generated 354 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:39:04.053450 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a2070c6a-8a0a-487f-b696-2ca0e8b89196 tempest-VolumesGetTestJSON-1622099496 tempest-VolumesGetTestJSON-1622099496-project] Calling method '.version_select at 0x7f47adbb4790>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:04.473011 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-a2070c6a-8a0a-487f-b696-2ca0e8b89196 tempest-VolumesGetTestJSON-1622099496 tempest-VolumesGetTestJSON-1622099496-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/9bda7d79-c247-43ce-a17c-e4bfa924d4d7" status: 202 len: 0 microversion: 2.1 time: 0.424723 Jul 12 17:39:04.473593 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1247 bytes} [Tue Jul 12 17:39:04 2022] DELETE /compute/v2.1/os-volumes/9bda7d79-c247-43ce-a17c-e4bfa924d4d7 => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:39:04.484384 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-c818e7ca-a590-4f9a-8d59-5eb5f6f94127 tempest-VolumesGetTestJSON-1622099496 tempest-VolumesGetTestJSON-1622099496-project] Calling method '.version_select at 0x7f47adbbf820>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:04.609713 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-c818e7ca-a590-4f9a-8d59-5eb5f6f94127 tempest-VolumesGetTestJSON-1622099496 tempest-VolumesGetTestJSON-1622099496-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9bda7d79-c247-43ce-a17c-e4bfa924d4d7" status: 200 len: 353 microversion: 2.1 time: 0.129954 Jul 12 17:39:04.610303 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 3/5] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jul 12 17:39:04 2022] GET /compute/v2.1/os-volumes/9bda7d79-c247-43ce-a17c-e4bfa924d4d7 => generated 353 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:39:05.624032 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-8b5308d6-4f21-4725-be5c-a45025f7247c tempest-VolumesGetTestJSON-1622099496 tempest-VolumesGetTestJSON-1622099496-project] Calling method '.version_select at 0x7f47adbb4280>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:05.665398 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-8b5308d6-4f21-4725-be5c-a45025f7247c tempest-VolumesGetTestJSON-1622099496 tempest-VolumesGetTestJSON-1622099496-project] HTTP exception thrown: Volume 9bda7d79-c247-43ce-a17c-e4bfa924d4d7 could not be found. Jul 12 17:39:05.669581 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-8b5308d6-4f21-4725-be5c-a45025f7247c tempest-VolumesGetTestJSON-1622099496 tempest-VolumesGetTestJSON-1622099496-project] Request method failure captured: Jul 12 17:39:05.669581 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: GET /compute/v2.1/os-volumes/9bda7d79-c247-43ce-a17c-e4bfa924d4d7 HTTP/1.1 Jul 12 17:39:05.669581 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:39:05.669581 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:39:05.669581 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:39:05.669581 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 0 Jul 12 17:39:05.669581 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:39:05.669581 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:39:05.669581 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:39:05.669581 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:39:05.669581 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbGyGj-rEdiVpzshlqpV-UDkcwoPqvDgYr826MB7o35Ab6Cn5DymAP3vXDarKGwe4hfla_Qaz1KACtEzHNLSd5bBoUjg5-ebZTAn5kxhaB2LUDG5G85ll3M1WuuG3Ehu4CZVijbj4yt_6Q_0-kyUNHeC4y67tH2U9EHdamKKhbLXlEI Jul 12 17:39:05.669581 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:39:05.669581 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:39:05.669581 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:39:05.669581 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:39:05.669581 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:39:05.669581 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:39:05.669581 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: 291ab35011594a95b495a19d62d15077 Jul 12 17:39:05.669581 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-VolumesGetTestJSON-1622099496 Jul 12 17:39:05.669581 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:39:05.669581 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:39:05.671033 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/291ab35011594a95b495a19d62d15077"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_291ab35011594a95b495a19d62d15077", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/291ab35011594a95b495a19d62d15077"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/291ab35011594a95b495a19d62d15077"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:39:05.671033 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-VolumesGetTestJSON-1622099496 Jul 12 17:39:05.671033 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: 291ab35011594a95b495a19d62d15077 Jul 12 17:39:05.671033 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-VolumesGetTestJSON-1622099496 Jul 12 17:39:05.671033 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-VolumesGetTestJSON-1622099496-project Jul 12 17:39:05.671033 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:39:05.671033 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:39:05.671033 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: bb1038d2409e4f8588edee88a3f8d89d Jul 12 17:39:05.671033 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-VolumesGetTestJSON-1622099496-project Jul 12 17:39:05.671033 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: Jul 12 17:39:05.671033 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Volume 9bda7d79-c247-43ce-a17c-e4bfa924d4d7 could not be found. Jul 12 17:39:05.671033 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'id': '9bda7d79-c247-43ce-a17c-e4bfa924d4d7'} Jul 12 17:39:05.671033 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:39:05.671711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:39:05.671711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 17:39:05.671711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 17:39:05.671711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 17:39:05.671711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 17:39:05.671711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 17:39:05.671711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 17:39:05.671711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 17:39:05.671711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 17:39:05.671711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 17:39:05.671711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 17:39:05.671711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 17:39:05.671711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 17:39:05.671711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 17:39:05.671711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 17:39:05.671711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9bda7d79-c247-43ce-a17c-e4bfa924d4d7 could not be found. (HTTP 404) (Request-ID: req-c2f1edfe-99a6-4f76-8fc4-c6fccbaedbcb) Jul 12 17:39:05.671711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:39:05.671711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:39:05.671711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:39:05.672759 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:39:05.672759 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 17:39:05.672759 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 17:39:05.672759 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 17:39:05.672759 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 17:39:05.672759 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 17:39:05.672759 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 17:39:05.672759 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 17:39:05.672759 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 17:39:05.672759 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 17:39:05.672759 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 17:39:05.672759 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 17:39:05.672759 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 17:39:05.672759 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 17:39:05.672759 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 17:39:05.672759 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 17:39:05.672759 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 17:39:05.672759 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 17:39:05.672759 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 17:39:05.675046 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 17:39:05.675046 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 17:39:05.675046 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 17:39:05.675046 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 17:39:05.675046 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9bda7d79-c247-43ce-a17c-e4bfa924d4d7 could not be found. Jul 12 17:39:05.675046 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:39:05.675046 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:39:05.675046 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:39:05.675046 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:39:05.675046 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:39:05.675046 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:39:05.675046 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:39:05.675046 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:39:05.675046 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 17:39:05.675046 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 17:39:05.675046 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:39:05.675046 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:39:05.675046 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 17:39:05.675046 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:39:05.677542 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9bda7d79-c247-43ce-a17c-e4bfa924d4d7 could not be found. Jul 12 17:39:05.677542 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:39:05.677542 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:39:05.677542 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:39:05.677542 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:39:05.677542 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:39:05.677542 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:39:05.677542 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:39:05.677542 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:39:05.677542 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9bda7d79-c247-43ce-a17c-e4bfa924d4d7 could not be found. Jul 12 17:39:05.677542 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:39:05.677542 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-8b5308d6-4f21-4725-be5c-a45025f7247c tempest-VolumesGetTestJSON-1622099496 tempest-VolumesGetTestJSON-1622099496-project] Returning 404 to user: Volume 9bda7d79-c247-43ce-a17c-e4bfa924d4d7 could not be found. {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:39:05.677542 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-8b5308d6-4f21-4725-be5c-a45025f7247c tempest-VolumesGetTestJSON-1622099496 tempest-VolumesGetTestJSON-1622099496-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9bda7d79-c247-43ce-a17c-e4bfa924d4d7" status: 404 len: 109 microversion: 2.1 time: 0.052268 Jul 12 17:39:05.677542 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 3/6] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jul 12 17:39:05 2022] GET /compute/v2.1/os-volumes/9bda7d79-c247-43ce-a17c-e4bfa924d4d7 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 17:39:14.721135 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-880aa4f7-185c-428e-b1f6-d98c89f38c9f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1029874407", "imageRef": "cb077f42-97cd-41cf-8758-764c562534f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:39:15.004371 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.network.neutron [None req-880aa4f7-185c-428e-b1f6-d98c89f38c9f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] validate_networks() for [('08bf24d0-d7c4-4e21-b068-c78f4d445841', None, None, None, None, None)] {{(pid=130058) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:39:18.936075 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-bf9f1fe4-6660-4713-b82b-798fc9d2b281 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Action: 'create', calling method: .version_select at 0x7f47ae5a2b80>, body: {"keypair": {"name": "tempest-keypair-945957238", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWrt7mipqGw1g9Iwns7gyG33GBUAwY58tncrCdQ0V4Wcu13jPXCpKc7Qdx8SWFWV4tUaGsgYRcRm4Ux6DThZ0CfIZX816tjlUrwuh0HZBTMxgtH4lH2STCMliUH/TdvPg=="}} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:39:18.990924 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-880aa4f7-185c-428e-b1f6-d98c89f38c9f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Flavor limits 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:39:18.992051 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-880aa4f7-185c-428e-b1f6-d98c89f38c9f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Image limits 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:39:18.992762 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-880aa4f7-185c-428e-b1f6-d98c89f38c9f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Flavor pref 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:39:18.993868 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-880aa4f7-185c-428e-b1f6-d98c89f38c9f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Image pref 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:39:18.995124 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-880aa4f7-185c-428e-b1f6-d98c89f38c9f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:39:19.027904 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-880aa4f7-185c-428e-b1f6-d98c89f38c9f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:19.030691 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-880aa4f7-185c-428e-b1f6-d98c89f38c9f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:19.033306 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-880aa4f7-185c-428e-b1f6-d98c89f38c9f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:19.035533 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-880aa4f7-185c-428e-b1f6-d98c89f38c9f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:19.085421 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-880aa4f7-185c-428e-b1f6-d98c89f38c9f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Getting quotas for project 497c73f9a78743e9b24b2b6ff47d7ede. Resources: {'cores', 'instances', 'ram'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:39:19.095437 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-880aa4f7-185c-428e-b1f6-d98c89f38c9f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Getting quotas for user ce09df98c929416e8ca67b0728349bfb and project 497c73f9a78743e9b24b2b6ff47d7ede. Resources: {'cores', 'instances', 'ram'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:39:19.111537 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-880aa4f7-185c-428e-b1f6-d98c89f38c9f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Going to run 1 instances... {{(pid=130058) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:39:19.117122 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-880aa4f7-185c-428e-b1f6-d98c89f38c9f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb077f42-97cd-41cf-8758-764c562534f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:39:19.117283 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.quota [None req-bf9f1fe4-6660-4713-b82b-798fc9d2b281 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Getting quotas for project 49227e443aa94a438bf7954aa0398cb9. Resources: {'key_pairs'} {{(pid=130059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:39:19.151232 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.quota [None req-bf9f1fe4-6660-4713-b82b-798fc9d2b281 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Getting quotas for user 9feeaf257bb441b7a14b57f1f493d08f and project 49227e443aa94a438bf7954aa0398cb9. Resources: {'key_pairs'} {{(pid=130059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:39:19.367249 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-bf9f1fe4-6660-4713-b82b-798fc9d2b281 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.261391 Jul 12 17:39:19.440476 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 4/7] 10.222.0.16 () {62 vars in 1199 bytes} [Tue Jul 12 17:39:18 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1263 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 12 17:39:19.442240 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-880aa4f7-185c-428e-b1f6-d98c89f38c9f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.181540 Jul 12 17:39:19.442240 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 4/8] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 12 17:39:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 5185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:39:19.442561 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-e16df17c-e474-4c58-b1f1-c329f9d1b127 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:19.442561 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-e16df17c-e474-4c58-b1f1-c329f9d1b127 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:20.379569 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-e16df17c-e474-4c58-b1f1-c329f9d1b127 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:20.402246 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-e16df17c-e474-4c58-b1f1-c329f9d1b127 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1222 microversion: 2.1 time: 0.984170 Jul 12 17:39:20.418796 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 5/9] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:19 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1222 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:20.451484 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-fc1fd031-efa4-4ad5-9fbe-6ad8b589a007 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Action: 'create', calling method: .version_select at 0x7f47adac7ee0>, body: {"keypair": {"name": "tempest-keypair-1075727624", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqn4QD1o40367jPGIGiYXjLKWUdlRYL79Tm5GgrLLRjjlParfEkAevpAF/2D1NXS4lLkXujn8ODhgIk1yEE+pxvbbS01tV4Ndw6c6zFMQMt2bgvrepkcdHVR9iLltuHRg=="}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:39:20.493941 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-fc1fd031-efa4-4ad5-9fbe-6ad8b589a007 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Getting quotas for project 84b840eaa59d4f73ac68926437f03d82. Resources: {'key_pairs'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:39:20.501659 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-fc1fd031-efa4-4ad5-9fbe-6ad8b589a007 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Getting quotas for user c8441a4a72154ee3bbb95af66abf2ffd and project 84b840eaa59d4f73ac68926437f03d82. Resources: {'key_pairs'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:39:20.631328 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-4600cdf8-01f0-4838-a209-d55293d0513c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-622866657", "imageRef": "cb077f42-97cd-41cf-8758-764c562534f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:39:20.694670 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-fc1fd031-efa4-4ad5-9fbe-6ad8b589a007 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.491657 Jul 12 17:39:20.702926 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 5/10] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Jul 12 17:39:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:39:20.770666 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.network.neutron [None req-4600cdf8-01f0-4838-a209-d55293d0513c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] validate_networks() for [('08bf24d0-d7c4-4e21-b068-c78f4d445841', None, None, None, None, None)] {{(pid=130059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:39:23.999966 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-4600cdf8-01f0-4838-a209-d55293d0513c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Flavor limits 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:39:24.000997 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-4600cdf8-01f0-4838-a209-d55293d0513c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Image limits 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:39:24.001722 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-4600cdf8-01f0-4838-a209-d55293d0513c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Flavor pref 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:39:24.002413 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-4600cdf8-01f0-4838-a209-d55293d0513c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Image pref 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:39:24.003072 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-4600cdf8-01f0-4838-a209-d55293d0513c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:39:24.040244 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4600cdf8-01f0-4838-a209-d55293d0513c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:24.046037 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4600cdf8-01f0-4838-a209-d55293d0513c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:24.050584 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4600cdf8-01f0-4838-a209-d55293d0513c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:24.055895 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4600cdf8-01f0-4838-a209-d55293d0513c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:24.126955 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.quota [None req-4600cdf8-01f0-4838-a209-d55293d0513c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Getting quotas for project 497c73f9a78743e9b24b2b6ff47d7ede. Resources: {'cores', 'instances', 'ram'} {{(pid=130059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:39:24.134598 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.quota [None req-4600cdf8-01f0-4838-a209-d55293d0513c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Getting quotas for user ce09df98c929416e8ca67b0728349bfb and project 497c73f9a78743e9b24b2b6ff47d7ede. Resources: {'cores', 'instances', 'ram'} {{(pid=130059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:39:24.152383 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-4600cdf8-01f0-4838-a209-d55293d0513c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Going to run 1 instances... {{(pid=130059) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:39:24.156533 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-4600cdf8-01f0-4838-a209-d55293d0513c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb077f42-97cd-41cf-8758-764c562534f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:39:24.479885 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-4600cdf8-01f0-4838-a209-d55293d0513c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.854080 Jul 12 17:39:24.486481 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 6/11] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 12 17:39:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 3861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 17:39:24.492205 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-66ce14b2-1c60-417a-9763-d3f00dfd6cbb tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:24.492832 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-66ce14b2-1c60-417a-9763-d3f00dfd6cbb tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:24.758892 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-98235698-16bd-45bb-b357-4cb07f452dd2 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1381398744", "imageRef": "cb077f42-97cd-41cf-8758-764c562534f4", "flavorRef": "452", "networks": [{"uuid": "723dcffb-daa8-499f-b883-0d22694bdfce"}]}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:39:24.910380 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.network.neutron [None req-98235698-16bd-45bb-b357-4cb07f452dd2 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] validate_networks() for [('723dcffb-daa8-499f-b883-0d22694bdfce', None, None, None, None, None)] {{(pid=130058) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:39:25.383047 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-66ce14b2-1c60-417a-9763-d3f00dfd6cbb tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:25.402316 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-66ce14b2-1c60-417a-9763-d3f00dfd6cbb tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1221 microversion: 2.1 time: 0.914100 Jul 12 17:39:25.419752 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 7/12] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:24 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1221 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:26.442119 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-27ec9956-2221-40ec-b220-8cd26b79a246 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:26.451763 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-27ec9956-2221-40ec-b220-8cd26b79a246 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:27.235711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-27ec9956-2221-40ec-b220-8cd26b79a246 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:27.246991 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-27ec9956-2221-40ec-b220-8cd26b79a246 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1221 microversion: 2.1 time: 0.813419 Jul 12 17:39:27.247840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 8/13] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:26 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1221 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:39:27.291255 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-98235698-16bd-45bb-b357-4cb07f452dd2 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Flavor limits 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:39:27.291713 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-98235698-16bd-45bb-b357-4cb07f452dd2 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Image limits 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:39:27.292196 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-98235698-16bd-45bb-b357-4cb07f452dd2 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Flavor pref 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:39:27.292822 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-98235698-16bd-45bb-b357-4cb07f452dd2 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Image pref 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:39:27.293247 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-98235698-16bd-45bb-b357-4cb07f452dd2 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:39:27.310488 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-98235698-16bd-45bb-b357-4cb07f452dd2 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:27.313933 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-98235698-16bd-45bb-b357-4cb07f452dd2 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:27.313933 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-98235698-16bd-45bb-b357-4cb07f452dd2 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:27.315895 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-98235698-16bd-45bb-b357-4cb07f452dd2 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:27.349574 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-98235698-16bd-45bb-b357-4cb07f452dd2 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Getting quotas for project 33a7a8fa558b472da92a52cdd63bdbad. Resources: {'cores', 'instances', 'ram'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:39:27.369617 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-98235698-16bd-45bb-b357-4cb07f452dd2 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Getting quotas for user cd79a28d8f774c1fac44185df36cd24f and project 33a7a8fa558b472da92a52cdd63bdbad. Resources: {'cores', 'instances', 'ram'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:39:27.419475 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-98235698-16bd-45bb-b357-4cb07f452dd2 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Going to run 1 instances... {{(pid=130058) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:39:27.423012 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-98235698-16bd-45bb-b357-4cb07f452dd2 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb077f42-97cd-41cf-8758-764c562534f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:39:27.662069 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-98235698-16bd-45bb-b357-4cb07f452dd2 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.849130 Jul 12 17:39:27.664511 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 6/14] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 12 17:39:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 3854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:39:27.674395 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-465c7d7b-6d80-4b20-aeec-5c19d87d04d7 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:27.675050 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-465c7d7b-6d80-4b20-aeec-5c19d87d04d7 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:28.123207 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-465c7d7b-6d80-4b20-aeec-5c19d87d04d7 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:28.134480 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-465c7d7b-6d80-4b20-aeec-5c19d87d04d7 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1215 microversion: 2.1 time: 0.464993 Jul 12 17:39:28.138912 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 9/15] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:27 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1215 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:28.268679 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b4c0222b-aecc-4d84-a73c-3b08d396ba57 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:28.270708 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-b4c0222b-aecc-4d84-a73c-3b08d396ba57 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:28.293519 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b4c0222b-aecc-4d84-a73c-3b08d396ba57 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:28.295123 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b4c0222b-aecc-4d84-a73c-3b08d396ba57 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:28.298100 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b4c0222b-aecc-4d84-a73c-3b08d396ba57 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:28.298100 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b4c0222b-aecc-4d84-a73c-3b08d396ba57 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:28.728181 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-b4c0222b-aecc-4d84-a73c-3b08d396ba57 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:28.758330 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-b4c0222b-aecc-4d84-a73c-3b08d396ba57 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1273 microversion: 2.1 time: 0.496554 Jul 12 17:39:28.762148 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 7/16] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:28 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1273 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:29.151869 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-33638552-e7cd-4416-8968-07b53e3fd93b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:29.153140 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-33638552-e7cd-4416-8968-07b53e3fd93b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:29.670574 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-33638552-e7cd-4416-8968-07b53e3fd93b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:29.670574 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-33638552-e7cd-4416-8968-07b53e3fd93b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1215 microversion: 2.1 time: 0.313743 Jul 12 17:39:29.670574 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 10/17] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:29 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1215 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:29.672831 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-a58f94dc-0b56-4db1-8eb4-7d3685234008 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-585742824", "imageRef": "cb077f42-97cd-41cf-8758-764c562534f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "788020f8-05a4-4c17-a8ec-9f084f5359c6"}], "security_groups": [{"name": "tempest-securitygroup--810042425"}], "key_name": "tempest-keypair-1075727624", "user_data": "}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:39:29.801802 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-d6777167-6acb-4a3a-85f3-1281bb25eed2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:29.804059 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-d6777167-6acb-4a3a-85f3-1281bb25eed2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:29.819089 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d6777167-6acb-4a3a-85f3-1281bb25eed2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:29.820608 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d6777167-6acb-4a3a-85f3-1281bb25eed2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:29.822660 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d6777167-6acb-4a3a-85f3-1281bb25eed2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:29.823843 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d6777167-6acb-4a3a-85f3-1281bb25eed2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:29.870444 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.network.neutron [None req-a58f94dc-0b56-4db1-8eb4-7d3685234008 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] validate_networks() for [('788020f8-05a4-4c17-a8ec-9f084f5359c6', None, None, None, None, None)] {{(pid=130058) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:39:30.641293 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-d6777167-6acb-4a3a-85f3-1281bb25eed2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:30.732119 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-d6777167-6acb-4a3a-85f3-1281bb25eed2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1281 microversion: 2.1 time: 0.924844 Jul 12 17:39:30.732119 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 11/18] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:29 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1281 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:30.732119 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-2dcee6cc-0376-4f9b-9a8b-04fdc8479591 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:30.732119 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-2dcee6cc-0376-4f9b-9a8b-04fdc8479591 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:30.765059 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2dcee6cc-0376-4f9b-9a8b-04fdc8479591 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:30.765789 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2dcee6cc-0376-4f9b-9a8b-04fdc8479591 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:30.766678 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2dcee6cc-0376-4f9b-9a8b-04fdc8479591 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:30.767213 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2dcee6cc-0376-4f9b-9a8b-04fdc8479591 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:31.027671 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-2dcee6cc-0376-4f9b-9a8b-04fdc8479591 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:31.043447 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-2dcee6cc-0376-4f9b-9a8b-04fdc8479591 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1211 microversion: 2.1 time: 0.332055 Jul 12 17:39:31.054004 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 12/19] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:30 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1211 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:31.079883 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-31a02f71-fc0d-45fb-ae4b-b2f16b9f785d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-72401795", "imageRef": "cb077f42-97cd-41cf-8758-764c562534f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4232e454-e413-42a8-88d8-67ab35c6cfbd"}], "security_groups": [{"name": "tempest-securitygroup--434690139"}], "key_name": "tempest-keypair-945957238", "user_data": "}} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:39:31.416496 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.network.neutron [None req-31a02f71-fc0d-45fb-ae4b-b2f16b9f785d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] validate_networks() for [('4232e454-e413-42a8-88d8-67ab35c6cfbd', None, None, None, None, None)] {{(pid=130059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:39:32.002533 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-a58f94dc-0b56-4db1-8eb4-7d3685234008 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Flavor limits 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:39:32.004013 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-a58f94dc-0b56-4db1-8eb4-7d3685234008 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Image limits 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:39:32.004751 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-a58f94dc-0b56-4db1-8eb4-7d3685234008 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Flavor pref 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:39:32.005416 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-a58f94dc-0b56-4db1-8eb4-7d3685234008 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Image pref 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:39:32.006235 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-a58f94dc-0b56-4db1-8eb4-7d3685234008 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:39:32.024799 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a58f94dc-0b56-4db1-8eb4-7d3685234008 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:32.024799 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a58f94dc-0b56-4db1-8eb4-7d3685234008 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:32.030209 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a58f94dc-0b56-4db1-8eb4-7d3685234008 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:32.032165 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a58f94dc-0b56-4db1-8eb4-7d3685234008 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:32.122238 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-a58f94dc-0b56-4db1-8eb4-7d3685234008 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Getting quotas for project 84b840eaa59d4f73ac68926437f03d82. Resources: {'cores', 'instances', 'ram'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:39:32.147742 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-a58f94dc-0b56-4db1-8eb4-7d3685234008 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Getting quotas for user c8441a4a72154ee3bbb95af66abf2ffd and project 84b840eaa59d4f73ac68926437f03d82. Resources: {'cores', 'instances', 'ram'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:39:32.193325 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-a58f94dc-0b56-4db1-8eb4-7d3685234008 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Going to run 1 instances... {{(pid=130058) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:39:32.200026 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-a58f94dc-0b56-4db1-8eb4-7d3685234008 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb077f42-97cd-41cf-8758-764c562534f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:39:32.462530 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-a58f94dc-0b56-4db1-8eb4-7d3685234008 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.821226 Jul 12 17:39:32.466861 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 8/20] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 12 17:39:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 2826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:39:32.504837 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-3c0d8e37-71de-4d37-be64-f45a8916bee6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:32.513266 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-3c0d8e37-71de-4d37-be64-f45a8916bee6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:32.545207 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3c0d8e37-71de-4d37-be64-f45a8916bee6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:32.545685 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3c0d8e37-71de-4d37-be64-f45a8916bee6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:32.552089 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3c0d8e37-71de-4d37-be64-f45a8916bee6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:32.553531 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3c0d8e37-71de-4d37-be64-f45a8916bee6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:32.884179 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-31a02f71-fc0d-45fb-ae4b-b2f16b9f785d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Flavor limits 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:39:32.884798 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-31a02f71-fc0d-45fb-ae4b-b2f16b9f785d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Image limits 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:39:32.885081 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-31a02f71-fc0d-45fb-ae4b-b2f16b9f785d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Flavor pref 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:39:32.885499 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-31a02f71-fc0d-45fb-ae4b-b2f16b9f785d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Image pref 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:39:32.885921 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-31a02f71-fc0d-45fb-ae4b-b2f16b9f785d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:39:32.929708 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-31a02f71-fc0d-45fb-ae4b-b2f16b9f785d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:32.930366 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-31a02f71-fc0d-45fb-ae4b-b2f16b9f785d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:32.937513 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-31a02f71-fc0d-45fb-ae4b-b2f16b9f785d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:32.943597 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-31a02f71-fc0d-45fb-ae4b-b2f16b9f785d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:32.984225 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.quota [None req-31a02f71-fc0d-45fb-ae4b-b2f16b9f785d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Getting quotas for project 49227e443aa94a438bf7954aa0398cb9. Resources: {'cores', 'instances', 'ram'} {{(pid=130059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:39:32.995002 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.quota [None req-31a02f71-fc0d-45fb-ae4b-b2f16b9f785d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Getting quotas for user 9feeaf257bb441b7a14b57f1f493d08f and project 49227e443aa94a438bf7954aa0398cb9. Resources: {'cores', 'instances', 'ram'} {{(pid=130059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:39:33.023489 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-31a02f71-fc0d-45fb-ae4b-b2f16b9f785d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Going to run 1 instances... {{(pid=130059) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:39:33.029613 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-31a02f71-fc0d-45fb-ae4b-b2f16b9f785d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb077f42-97cd-41cf-8758-764c562534f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:39:33.277131 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-31a02f71-fc0d-45fb-ae4b-b2f16b9f785d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.225344 Jul 12 17:39:33.277131 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 13/21] 10.222.0.16 () {62 vars in 1187 bytes} [Tue Jul 12 17:39:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 2230 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 12 17:39:33.294797 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-2d9e0b3b-a4b4-44c2-b0ef-f8a41b811ba8 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:33.296820 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-2d9e0b3b-a4b4-44c2-b0ef-f8a41b811ba8 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:33.350479 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2d9e0b3b-a4b4-44c2-b0ef-f8a41b811ba8 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:33.355945 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2d9e0b3b-a4b4-44c2-b0ef-f8a41b811ba8 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:33.359868 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2d9e0b3b-a4b4-44c2-b0ef-f8a41b811ba8 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:33.363601 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2d9e0b3b-a4b4-44c2-b0ef-f8a41b811ba8 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:33.741144 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-3c0d8e37-71de-4d37-be64-f45a8916bee6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:33.762999 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-3c0d8e37-71de-4d37-be64-f45a8916bee6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1321 microversion: 2.1 time: 1.293427 Jul 12 17:39:33.777146 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 9/22] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:32 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1321 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:33.793645 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-ef8bc90f-0f4b-4bad-a9b5-f930c5410e1f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:33.795665 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-ef8bc90f-0f4b-4bad-a9b5-f930c5410e1f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:34.127383 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-2d9e0b3b-a4b4-44c2-b0ef-f8a41b811ba8 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:34.140218 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-2d9e0b3b-a4b4-44c2-b0ef-f8a41b811ba8 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1273 microversion: 2.1 time: 0.864225 Jul 12 17:39:34.161918 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 14/23] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:33 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1273 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:34.211278 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-99c5d498-45e4-4eaf-abc1-29ac8a4ee3a2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:34.211278 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-99c5d498-45e4-4eaf-abc1-29ac8a4ee3a2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:34.218353 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ef8bc90f-0f4b-4bad-a9b5-f930c5410e1f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:34.253538 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-ef8bc90f-0f4b-4bad-a9b5-f930c5410e1f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 200 len: 1241 microversion: 2.1 time: 0.474086 Jul 12 17:39:34.255979 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 10/24] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:33 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 1241 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:34.754878 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-99c5d498-45e4-4eaf-abc1-29ac8a4ee3a2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:34.770640 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-99c5d498-45e4-4eaf-abc1-29ac8a4ee3a2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:34.772493 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-99c5d498-45e4-4eaf-abc1-29ac8a4ee3a2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:34.773762 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-99c5d498-45e4-4eaf-abc1-29ac8a4ee3a2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1279 microversion: 2.20 time: 0.610410 Jul 12 17:39:34.774377 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 15/25] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:39:34 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1279 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:39:34.787599 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-9050f9f5-8258-4106-b81e-f1cd88be74c9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:34.788855 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-9050f9f5-8258-4106-b81e-f1cd88be74c9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:34.813497 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9050f9f5-8258-4106-b81e-f1cd88be74c9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:34.814010 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9050f9f5-8258-4106-b81e-f1cd88be74c9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:34.819071 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9050f9f5-8258-4106-b81e-f1cd88be74c9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:34.819071 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9050f9f5-8258-4106-b81e-f1cd88be74c9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:35.165764 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-691a430d-5ed5-4bf3-8c7c-c2428fbb0743 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:35.167322 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-691a430d-5ed5-4bf3-8c7c-c2428fbb0743 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:35.178304 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-691a430d-5ed5-4bf3-8c7c-c2428fbb0743 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:35.179373 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-691a430d-5ed5-4bf3-8c7c-c2428fbb0743 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:35.201666 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-691a430d-5ed5-4bf3-8c7c-c2428fbb0743 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:35.203233 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-691a430d-5ed5-4bf3-8c7c-c2428fbb0743 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:35.437912 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-691a430d-5ed5-4bf3-8c7c-c2428fbb0743 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:35.445851 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-691a430d-5ed5-4bf3-8c7c-c2428fbb0743 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1273 microversion: 2.1 time: 0.284348 Jul 12 17:39:35.447974 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 16/26] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:35 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1273 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:35.460631 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-e0f8d49b-6de7-4793-8e9c-58efd507484a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:35.461788 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-e0f8d49b-6de7-4793-8e9c-58efd507484a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:35.471612 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e0f8d49b-6de7-4793-8e9c-58efd507484a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:35.474253 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e0f8d49b-6de7-4793-8e9c-58efd507484a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:35.474253 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e0f8d49b-6de7-4793-8e9c-58efd507484a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:35.474587 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e0f8d49b-6de7-4793-8e9c-58efd507484a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:35.698455 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-9050f9f5-8258-4106-b81e-f1cd88be74c9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:35.713999 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-9050f9f5-8258-4106-b81e-f1cd88be74c9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1321 microversion: 2.1 time: 0.933782 Jul 12 17:39:35.724805 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 11/27] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:34 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1321 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:35.746847 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-e0f8d49b-6de7-4793-8e9c-58efd507484a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:35.766244 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-e0f8d49b-6de7-4793-8e9c-58efd507484a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 200 len: 1237 microversion: 2.1 time: 0.315682 Jul 12 17:39:35.773947 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 17/28] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:35 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 1237 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:35.798848 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-eb84f2f3-fb18-48f3-bc9e-2109898d2a7a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:35.804549 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-eb84f2f3-fb18-48f3-bc9e-2109898d2a7a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:35.830206 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-eb84f2f3-fb18-48f3-bc9e-2109898d2a7a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:35.840218 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-eb84f2f3-fb18-48f3-bc9e-2109898d2a7a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:35.844691 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-eb84f2f3-fb18-48f3-bc9e-2109898d2a7a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:35.845261 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-eb84f2f3-fb18-48f3-bc9e-2109898d2a7a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:36.008912 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-eb84f2f3-fb18-48f3-bc9e-2109898d2a7a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:36.018613 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-eb84f2f3-fb18-48f3-bc9e-2109898d2a7a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:36.020409 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-eb84f2f3-fb18-48f3-bc9e-2109898d2a7a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:36.021907 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-eb84f2f3-fb18-48f3-bc9e-2109898d2a7a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1283 microversion: 2.20 time: 0.228346 Jul 12 17:39:36.034279 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 12/29] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:39:35 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1283 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:39:36.464209 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-7e6f741e-7667-4921-bcd3-0f308e2b2727 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:36.464836 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-7e6f741e-7667-4921-bcd3-0f308e2b2727 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:36.471905 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7e6f741e-7667-4921-bcd3-0f308e2b2727 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:36.472398 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7e6f741e-7667-4921-bcd3-0f308e2b2727 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:36.480152 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7e6f741e-7667-4921-bcd3-0f308e2b2727 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:36.480152 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7e6f741e-7667-4921-bcd3-0f308e2b2727 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:36.580621 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-7e6f741e-7667-4921-bcd3-0f308e2b2727 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:36.596447 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-7e6f741e-7667-4921-bcd3-0f308e2b2727 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1273 microversion: 2.1 time: 0.134229 Jul 12 17:39:36.608047 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 18/30] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:36 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1273 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:36.732676 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-bdf2857a-3663-44d5-aea5-e629239bed61 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:36.733858 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-bdf2857a-3663-44d5-aea5-e629239bed61 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:36.744915 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bdf2857a-3663-44d5-aea5-e629239bed61 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:36.745853 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bdf2857a-3663-44d5-aea5-e629239bed61 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:36.746987 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bdf2857a-3663-44d5-aea5-e629239bed61 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:36.747604 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bdf2857a-3663-44d5-aea5-e629239bed61 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:36.795253 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-4fac48bb-90a8-4215-8772-fce6c5b7a37d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:36.801184 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-4fac48bb-90a8-4215-8772-fce6c5b7a37d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:36.826309 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4fac48bb-90a8-4215-8772-fce6c5b7a37d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:36.827722 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4fac48bb-90a8-4215-8772-fce6c5b7a37d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:36.832746 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4fac48bb-90a8-4215-8772-fce6c5b7a37d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:36.843059 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4fac48bb-90a8-4215-8772-fce6c5b7a37d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:37.117943 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-4fac48bb-90a8-4215-8772-fce6c5b7a37d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:37.135136 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-4fac48bb-90a8-4215-8772-fce6c5b7a37d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 200 len: 1293 microversion: 2.1 time: 0.346288 Jul 12 17:39:37.147016 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 19/31] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:36 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 1293 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:37.148213 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-9b5e7a5a-9b26-4889-9206-9f87b22cdb7a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:37.156546 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-9b5e7a5a-9b26-4889-9206-9f87b22cdb7a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:37.185144 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9b5e7a5a-9b26-4889-9206-9f87b22cdb7a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:37.185144 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9b5e7a5a-9b26-4889-9206-9f87b22cdb7a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:37.187798 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9b5e7a5a-9b26-4889-9206-9f87b22cdb7a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:37.193644 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9b5e7a5a-9b26-4889-9206-9f87b22cdb7a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:37.350408 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-bdf2857a-3663-44d5-aea5-e629239bed61 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:37.360181 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-bdf2857a-3663-44d5-aea5-e629239bed61 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1321 microversion: 2.1 time: 0.631804 Jul 12 17:39:37.360804 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 13/32] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:36 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1321 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:37.689896 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-9b5e7a5a-9b26-4889-9206-9f87b22cdb7a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:37.718927 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-9b5e7a5a-9b26-4889-9206-9f87b22cdb7a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:37.724965 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-9b5e7a5a-9b26-4889-9206-9f87b22cdb7a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:37.726148 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-9b5e7a5a-9b26-4889-9206-9f87b22cdb7a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1275 microversion: 2.20 time: 0.586431 Jul 12 17:39:37.726840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 20/33] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:39:37 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1275 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:39:37.743747 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-4fe5e973-5201-4b0a-a6b8-8f5c218cae1d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:37.751233 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-4fe5e973-5201-4b0a-a6b8-8f5c218cae1d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:37.778955 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4fe5e973-5201-4b0a-a6b8-8f5c218cae1d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:37.779427 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4fe5e973-5201-4b0a-a6b8-8f5c218cae1d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:37.780883 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4fe5e973-5201-4b0a-a6b8-8f5c218cae1d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:37.781356 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4fe5e973-5201-4b0a-a6b8-8f5c218cae1d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:37.927164 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-db97d370-031d-40c0-aee9-513460a88d3c req-fa1e2ecd-1cc7-4d62-b523-3fb371eeb95d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c50a610-ffbb-40cc-b1d3-b05a598c7e3a", "tag": "5f828fa0-9a14-4714-96d9-422ef2b20526"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:39:37.954093 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-db97d370-031d-40c0-aee9-513460a88d3c req-fa1e2ecd-1cc7-4d62-b523-3fb371eeb95d service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:37.956826 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-db97d370-031d-40c0-aee9-513460a88d3c req-fa1e2ecd-1cc7-4d62-b523-3fb371eeb95d service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:38.013304 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-db97d370-031d-40c0-aee9-513460a88d3c req-fa1e2ecd-1cc7-4d62-b523-3fb371eeb95d service nova] Creating event network-changed:5f828fa0-9a14-4714-96d9-422ef2b20526 for instance 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a on hv-cinder-84875 Jul 12 17:39:38.017295 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-db97d370-031d-40c0-aee9-513460a88d3c req-fa1e2ecd-1cc7-4d62-b523-3fb371eeb95d service nova] Acquired lock "compute-rpcapi-router" {{(pid=130058) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 12 17:39:38.021203 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cc766a93-086b-4dde-be38-bfdb75eb8efa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:38.021686 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cc766a93-086b-4dde-be38-bfdb75eb8efa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:38.023629 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cc766a93-086b-4dde-be38-bfdb75eb8efa None None] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:38.025022 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cc766a93-086b-4dde-be38-bfdb75eb8efa None None] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:38.059095 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.compute.rpcapi [None req-cc766a93-086b-4dde-be38-bfdb75eb8efa None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 12 17:39:38.060211 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cc766a93-086b-4dde-be38-bfdb75eb8efa None None] Releasing lock "compute-rpcapi-router" {{(pid=130058) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 12 17:39:38.096616 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-cc766a93-086b-4dde-be38-bfdb75eb8efa None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.731308 Jul 12 17:39:38.097835 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 14/34] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:39:38.158001 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-9c915e18-bc32-4ea4-864c-3a10e7cf690f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:38.158945 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-9c915e18-bc32-4ea4-864c-3a10e7cf690f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:38.171919 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9c915e18-bc32-4ea4-864c-3a10e7cf690f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:38.171919 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9c915e18-bc32-4ea4-864c-3a10e7cf690f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:38.171919 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9c915e18-bc32-4ea4-864c-3a10e7cf690f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:38.171919 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9c915e18-bc32-4ea4-864c-3a10e7cf690f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:38.447535 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-9c915e18-bc32-4ea4-864c-3a10e7cf690f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:38.459239 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-9c915e18-bc32-4ea4-864c-3a10e7cf690f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 200 len: 1311 microversion: 2.1 time: 0.307232 Jul 12 17:39:38.464803 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 15/35] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:38 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 1311 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:38.475575 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-416e06c2-9c1a-41d9-94f3-0f4307149a13 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:38.476111 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-416e06c2-9c1a-41d9-94f3-0f4307149a13 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:38.487181 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-416e06c2-9c1a-41d9-94f3-0f4307149a13 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:38.487883 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-416e06c2-9c1a-41d9-94f3-0f4307149a13 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:38.489805 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-416e06c2-9c1a-41d9-94f3-0f4307149a13 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:38.490417 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-416e06c2-9c1a-41d9-94f3-0f4307149a13 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:38.649529 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-4fe5e973-5201-4b0a-a6b8-8f5c218cae1d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:38.665293 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-4fe5e973-5201-4b0a-a6b8-8f5c218cae1d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1315 microversion: 2.1 time: 0.935538 Jul 12 17:39:38.665764 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 21/36] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:37 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1315 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:38.836642 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-1c2db3ee-cb6f-4172-be87-1de744331064 req-c9d6c914-f0af-4b76-91d9-9eea684af89d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64", "tag": "1ff07e21-5b8b-4e11-aaf6-3fff31f7dbba"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:39:38.862747 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-1c2db3ee-cb6f-4172-be87-1de744331064 req-c9d6c914-f0af-4b76-91d9-9eea684af89d service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:38.863217 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-1c2db3ee-cb6f-4172-be87-1de744331064 req-c9d6c914-f0af-4b76-91d9-9eea684af89d service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:38.924034 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-1c2db3ee-cb6f-4172-be87-1de744331064 req-c9d6c914-f0af-4b76-91d9-9eea684af89d service nova] Creating event network-changed:1ff07e21-5b8b-4e11-aaf6-3fff31f7dbba for instance 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 on hv-cinder-84875 Jul 12 17:39:38.924776 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-1c2db3ee-cb6f-4172-be87-1de744331064 req-c9d6c914-f0af-4b76-91d9-9eea684af89d service nova] Acquired lock "compute-rpcapi-router" {{(pid=130059) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 12 17:39:38.927195 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2fe6e95b-6b4d-441a-88a4-7630fec17e3f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:38.928149 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2fe6e95b-6b4d-441a-88a4-7630fec17e3f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:38.929831 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2fe6e95b-6b4d-441a-88a4-7630fec17e3f None None] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:38.930828 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2fe6e95b-6b4d-441a-88a4-7630fec17e3f None None] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:38.941616 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.compute.rpcapi [None req-2fe6e95b-6b4d-441a-88a4-7630fec17e3f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 12 17:39:38.943190 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2fe6e95b-6b4d-441a-88a4-7630fec17e3f None None] Releasing lock "compute-rpcapi-router" {{(pid=130059) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 12 17:39:38.997629 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-2fe6e95b-6b4d-441a-88a4-7630fec17e3f None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.291351 Jul 12 17:39:38.999576 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 22/37] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:39:39.006409 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-fd0e283e-0cfb-4de8-a125-b150584e8619 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:39.022834 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-fd0e283e-0cfb-4de8-a125-b150584e8619 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:39.050821 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fd0e283e-0cfb-4de8-a125-b150584e8619 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:39.052315 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fd0e283e-0cfb-4de8-a125-b150584e8619 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:39.055465 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fd0e283e-0cfb-4de8-a125-b150584e8619 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:39.057375 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fd0e283e-0cfb-4de8-a125-b150584e8619 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:39.353184 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-fd0e283e-0cfb-4de8-a125-b150584e8619 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:39.366075 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-fd0e283e-0cfb-4de8-a125-b150584e8619 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:39.376937 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-fd0e283e-0cfb-4de8-a125-b150584e8619 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:39.378280 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-fd0e283e-0cfb-4de8-a125-b150584e8619 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1349 microversion: 2.20 time: 0.376926 Jul 12 17:39:39.390457 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 23/38] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:39:38 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1349 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:39:39.486280 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-cff90265-7f6f-44af-adb5-182f48552e3b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:39.486871 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-cff90265-7f6f-44af-adb5-182f48552e3b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:39.502868 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cff90265-7f6f-44af-adb5-182f48552e3b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:39.503421 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cff90265-7f6f-44af-adb5-182f48552e3b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:39.504269 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cff90265-7f6f-44af-adb5-182f48552e3b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:39.505124 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cff90265-7f6f-44af-adb5-182f48552e3b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:39.694950 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-416e06c2-9c1a-41d9-94f3-0f4307149a13 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:39.706514 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-416e06c2-9c1a-41d9-94f3-0f4307149a13 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1321 microversion: 2.1 time: 1.238954 Jul 12 17:39:39.707795 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 16/39] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:38 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1321 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:39.735129 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-9f97de9f-659e-4a1b-9675-2050c3ea05fa tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:39.738267 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-9f97de9f-659e-4a1b-9675-2050c3ea05fa tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:39.759881 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9f97de9f-659e-4a1b-9675-2050c3ea05fa tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:39.763180 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9f97de9f-659e-4a1b-9675-2050c3ea05fa tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:39.770416 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9f97de9f-659e-4a1b-9675-2050c3ea05fa tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:39.772034 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9f97de9f-659e-4a1b-9675-2050c3ea05fa tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:39.946844 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-cff90265-7f6f-44af-adb5-182f48552e3b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:39.965364 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-cff90265-7f6f-44af-adb5-182f48552e3b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 200 len: 1299 microversion: 2.1 time: 0.484398 Jul 12 17:39:39.982197 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 24/40] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:39 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 1299 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:40.406192 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-8c297d84-1969-4f0d-b5f1-d92cf7d702a7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:40.409216 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-8c297d84-1969-4f0d-b5f1-d92cf7d702a7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:40.428866 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8c297d84-1969-4f0d-b5f1-d92cf7d702a7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:40.430791 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8c297d84-1969-4f0d-b5f1-d92cf7d702a7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:40.433429 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8c297d84-1969-4f0d-b5f1-d92cf7d702a7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:40.434967 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8c297d84-1969-4f0d-b5f1-d92cf7d702a7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:40.495194 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-9f97de9f-659e-4a1b-9675-2050c3ea05fa tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:40.557998 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-9f97de9f-659e-4a1b-9675-2050c3ea05fa tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1315 microversion: 2.1 time: 0.848542 Jul 12 17:39:40.558668 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 17/41] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:39 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1315 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:40.678517 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-8c297d84-1969-4f0d-b5f1-d92cf7d702a7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:40.700544 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-8c297d84-1969-4f0d-b5f1-d92cf7d702a7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:40.702774 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-8c297d84-1969-4f0d-b5f1-d92cf7d702a7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:40.704615 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-8c297d84-1969-4f0d-b5f1-d92cf7d702a7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1337 microversion: 2.20 time: 0.309930 Jul 12 17:39:40.705551 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 25/42] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:39:40 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1337 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:39:40.727558 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b320c5f0-5575-43e6-9e5d-70655796b11a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:40.729219 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-b320c5f0-5575-43e6-9e5d-70655796b11a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:40.749686 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b320c5f0-5575-43e6-9e5d-70655796b11a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:40.749870 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b320c5f0-5575-43e6-9e5d-70655796b11a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:40.751263 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b320c5f0-5575-43e6-9e5d-70655796b11a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:40.751263 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b320c5f0-5575-43e6-9e5d-70655796b11a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:40.990849 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-b8890228-b39c-4b65-87c4-0569fc37b7e1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:40.991744 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-b8890228-b39c-4b65-87c4-0569fc37b7e1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:41.008063 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b8890228-b39c-4b65-87c4-0569fc37b7e1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:41.019066 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b8890228-b39c-4b65-87c4-0569fc37b7e1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:41.020130 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b8890228-b39c-4b65-87c4-0569fc37b7e1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:41.020814 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b8890228-b39c-4b65-87c4-0569fc37b7e1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:41.195074 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-b8890228-b39c-4b65-87c4-0569fc37b7e1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:41.206611 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-b8890228-b39c-4b65-87c4-0569fc37b7e1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 200 len: 1299 microversion: 2.1 time: 0.220438 Jul 12 17:39:41.218086 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 26/43] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:40 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 1299 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:41.362975 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-d2346b2b-34e6-47c3-84c6-25b1cad76293 req-5c222193-75fb-4be5-a9da-045c05126ecc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "407f15c2-26ad-460c-b4cd-281bc67c5c0d", "tag": "51b4a1d7-d75e-4513-9fce-09137564d4ec"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:39:41.376119 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:39:41.379979 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-d2346b2b-34e6-47c3-84c6-25b1cad76293 req-5c222193-75fb-4be5-a9da-045c05126ecc service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:41.386106 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-b320c5f0-5575-43e6-9e5d-70655796b11a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:41.391425 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-d2346b2b-34e6-47c3-84c6-25b1cad76293 req-5c222193-75fb-4be5-a9da-045c05126ecc service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:41.400890 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-b320c5f0-5575-43e6-9e5d-70655796b11a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1321 microversion: 2.1 time: 0.679491 Jul 12 17:39:41.409819 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 18/44] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:40 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1321 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:41.419328 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-d2346b2b-34e6-47c3-84c6-25b1cad76293 req-5c222193-75fb-4be5-a9da-045c05126ecc service nova] Creating event network-changed:51b4a1d7-d75e-4513-9fce-09137564d4ec for instance 407f15c2-26ad-460c-b4cd-281bc67c5c0d on hv-cinder-84875 Jul 12 17:39:41.443260 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-d2346b2b-34e6-47c3-84c6-25b1cad76293 req-5c222193-75fb-4be5-a9da-045c05126ecc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084154 Jul 12 17:39:41.443959 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 27/45] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:39:41.586453 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-223a7fd3-75b8-40eb-8173-7a7682a057ca tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:41.592605 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-223a7fd3-75b8-40eb-8173-7a7682a057ca tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:41.614361 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-223a7fd3-75b8-40eb-8173-7a7682a057ca tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:41.615309 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-223a7fd3-75b8-40eb-8173-7a7682a057ca tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:41.616542 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-223a7fd3-75b8-40eb-8173-7a7682a057ca tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:41.617612 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-223a7fd3-75b8-40eb-8173-7a7682a057ca tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:41.731091 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-8003e7ec-b4e9-4fdd-9b17-d58c82feb3ae tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:41.735805 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-8003e7ec-b4e9-4fdd-9b17-d58c82feb3ae tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:41.758781 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8003e7ec-b4e9-4fdd-9b17-d58c82feb3ae tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:41.759464 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8003e7ec-b4e9-4fdd-9b17-d58c82feb3ae tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:41.769071 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8003e7ec-b4e9-4fdd-9b17-d58c82feb3ae tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:41.770252 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8003e7ec-b4e9-4fdd-9b17-d58c82feb3ae tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:42.078331 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-8003e7ec-b4e9-4fdd-9b17-d58c82feb3ae tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:42.103099 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-8003e7ec-b4e9-4fdd-9b17-d58c82feb3ae tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:42.105761 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-8003e7ec-b4e9-4fdd-9b17-d58c82feb3ae tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:42.107143 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-8003e7ec-b4e9-4fdd-9b17-d58c82feb3ae tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1337 microversion: 2.20 time: 0.387164 Jul 12 17:39:42.107839 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 28/46] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:39:41 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1337 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:39:42.225580 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-7411bacd-c2e4-4ae2-81e9-fcad87eb4912 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:42.226207 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-7411bacd-c2e4-4ae2-81e9-fcad87eb4912 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:42.246313 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7411bacd-c2e4-4ae2-81e9-fcad87eb4912 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:42.246313 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7411bacd-c2e4-4ae2-81e9-fcad87eb4912 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:42.246313 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7411bacd-c2e4-4ae2-81e9-fcad87eb4912 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:42.246313 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7411bacd-c2e4-4ae2-81e9-fcad87eb4912 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:42.257872 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-223a7fd3-75b8-40eb-8173-7a7682a057ca tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:42.274574 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-223a7fd3-75b8-40eb-8173-7a7682a057ca tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1315 microversion: 2.1 time: 0.700402 Jul 12 17:39:42.276961 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 19/47] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:41 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1315 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:42.433738 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b1d91eee-7f20-483f-9e21-f6ca895270a9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:42.437275 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-b1d91eee-7f20-483f-9e21-f6ca895270a9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:42.457244 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b1d91eee-7f20-483f-9e21-f6ca895270a9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:42.458686 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b1d91eee-7f20-483f-9e21-f6ca895270a9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:42.459952 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b1d91eee-7f20-483f-9e21-f6ca895270a9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:42.476411 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b1d91eee-7f20-483f-9e21-f6ca895270a9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:42.966495 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-b1d91eee-7f20-483f-9e21-f6ca895270a9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:42.979119 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-b1d91eee-7f20-483f-9e21-f6ca895270a9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1321 microversion: 2.1 time: 0.555026 Jul 12 17:39:42.983869 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 20/48] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:42 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1321 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:43.127445 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-cefe8feb-2e77-491d-a695-b4836e6b351d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:43.128209 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-cefe8feb-2e77-491d-a695-b4836e6b351d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:43.164265 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cefe8feb-2e77-491d-a695-b4836e6b351d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:43.169011 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cefe8feb-2e77-491d-a695-b4836e6b351d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:43.169011 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cefe8feb-2e77-491d-a695-b4836e6b351d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:43.174857 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cefe8feb-2e77-491d-a695-b4836e6b351d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:43.294154 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-7411bacd-c2e4-4ae2-81e9-fcad87eb4912 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:43.299384 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=100 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:39:43.315086 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-7411bacd-c2e4-4ae2-81e9-fcad87eb4912 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 200 len: 1366 microversion: 2.1 time: 1.093323 Jul 12 17:39:43.325759 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 29/49] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:42 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 1366 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:43.331669 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-86e170e3-2343-4f9b-b376-74d1b620519f tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:43.335924 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-86e170e3-2343-4f9b-b376-74d1b620519f tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:43.367753 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-86e170e3-2343-4f9b-b376-74d1b620519f tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:43.368677 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-86e170e3-2343-4f9b-b376-74d1b620519f tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:43.369711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-86e170e3-2343-4f9b-b376-74d1b620519f tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:43.371354 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-86e170e3-2343-4f9b-b376-74d1b620519f tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:43.708575 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-cefe8feb-2e77-491d-a695-b4836e6b351d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:43.724559 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-cefe8feb-2e77-491d-a695-b4836e6b351d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:43.726457 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-cefe8feb-2e77-491d-a695-b4836e6b351d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:43.731350 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-cefe8feb-2e77-491d-a695-b4836e6b351d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1404 microversion: 2.20 time: 0.609720 Jul 12 17:39:43.740875 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 21/50] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:39:43 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1404 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:39:43.754295 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-86e170e3-2343-4f9b-b376-74d1b620519f tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:43.766821 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-86e170e3-2343-4f9b-b376-74d1b620519f tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1315 microversion: 2.1 time: 0.439451 Jul 12 17:39:43.767608 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 30/51] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:43 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:44.002799 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-e53232dc-4ae2-4ac3-bb13-5b3f5529b6d9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:44.004088 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-e53232dc-4ae2-4ac3-bb13-5b3f5529b6d9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:44.013031 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e53232dc-4ae2-4ac3-bb13-5b3f5529b6d9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:44.015490 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e53232dc-4ae2-4ac3-bb13-5b3f5529b6d9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:44.017919 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e53232dc-4ae2-4ac3-bb13-5b3f5529b6d9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:44.019223 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e53232dc-4ae2-4ac3-bb13-5b3f5529b6d9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:44.237036 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell0:SELECT=24 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:39:44.333808 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-c8bf8bd4-fa5f-46b8-b665-cf33eab4621e tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:44.334473 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-c8bf8bd4-fa5f-46b8-b665-cf33eab4621e tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:44.342634 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c8bf8bd4-fa5f-46b8-b665-cf33eab4621e tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:44.344052 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c8bf8bd4-fa5f-46b8-b665-cf33eab4621e tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:44.344052 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c8bf8bd4-fa5f-46b8-b665-cf33eab4621e tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:44.344635 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c8bf8bd4-fa5f-46b8-b665-cf33eab4621e tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:44.589377 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-e53232dc-4ae2-4ac3-bb13-5b3f5529b6d9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:44.591961 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=87 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:39:44.601301 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-e53232dc-4ae2-4ac3-bb13-5b3f5529b6d9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1321 microversion: 2.1 time: 0.603133 Jul 12 17:39:44.609554 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 22/52] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:43 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1321 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:44.624686 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-9ec83b7d-eddf-43c0-94ea-a80bb371ff96 req-8ac6ce15-594c-4e1d-9af8-bf2efc16a789 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edf55e8a-cbc1-45b6-a138-21d5a07301d9", "tag": "e8c8b0fc-808c-4c82-a0f6-91314b49f8a9"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:39:44.643053 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=10 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:39:44.645795 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-9ec83b7d-eddf-43c0-94ea-a80bb371ff96 req-8ac6ce15-594c-4e1d-9af8-bf2efc16a789 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:44.650946 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-9ec83b7d-eddf-43c0-94ea-a80bb371ff96 req-8ac6ce15-594c-4e1d-9af8-bf2efc16a789 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:44.686891 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-9ec83b7d-eddf-43c0-94ea-a80bb371ff96 req-8ac6ce15-594c-4e1d-9af8-bf2efc16a789 service nova] Creating event network-changed:e8c8b0fc-808c-4c82-a0f6-91314b49f8a9 for instance edf55e8a-cbc1-45b6-a138-21d5a07301d9 on hv-cinder-84875 Jul 12 17:39:44.702956 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-9ec83b7d-eddf-43c0-94ea-a80bb371ff96 req-8ac6ce15-594c-4e1d-9af8-bf2efc16a789 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090403 Jul 12 17:39:44.705536 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 23/53] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:39:44.759543 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-72b4da74-b43b-4ec9-a46b-e14f8a749807 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:44.760517 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-72b4da74-b43b-4ec9-a46b-e14f8a749807 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:44.764027 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell0:SELECT=28 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:39:44.777144 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-72b4da74-b43b-4ec9-a46b-e14f8a749807 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:44.780696 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-72b4da74-b43b-4ec9-a46b-e14f8a749807 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:44.783474 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-72b4da74-b43b-4ec9-a46b-e14f8a749807 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:44.784071 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-72b4da74-b43b-4ec9-a46b-e14f8a749807 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:45.141957 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-c8bf8bd4-fa5f-46b8-b665-cf33eab4621e tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:45.152976 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-c8bf8bd4-fa5f-46b8-b665-cf33eab4621e tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 200 len: 1366 microversion: 2.1 time: 0.822738 Jul 12 17:39:45.165357 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 31/54] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:44 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 1366 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:39:45.171642 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-8c2989a8-b019-43b3-baa3-9e4fa4e1d0bc tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:45.172584 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-8c2989a8-b019-43b3-baa3-9e4fa4e1d0bc tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:45.181145 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8c2989a8-b019-43b3-baa3-9e4fa4e1d0bc tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:45.183167 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8c2989a8-b019-43b3-baa3-9e4fa4e1d0bc tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:45.184175 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8c2989a8-b019-43b3-baa3-9e4fa4e1d0bc tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:45.184769 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8c2989a8-b019-43b3-baa3-9e4fa4e1d0bc tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:45.200162 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-72b4da74-b43b-4ec9-a46b-e14f8a749807 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:45.236731 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-72b4da74-b43b-4ec9-a46b-e14f8a749807 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:45.246553 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-72b4da74-b43b-4ec9-a46b-e14f8a749807 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:45.253715 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-72b4da74-b43b-4ec9-a46b-e14f8a749807 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1404 microversion: 2.20 time: 0.496706 Jul 12 17:39:45.281779 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 24/55] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:39:44 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1404 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:39:45.424614 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-8c2989a8-b019-43b3-baa3-9e4fa4e1d0bc tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:45.434771 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-8c2989a8-b019-43b3-baa3-9e4fa4e1d0bc tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1315 microversion: 2.1 time: 0.267760 Jul 12 17:39:45.435935 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 32/56] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:45 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:45.623509 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-3631060c-f480-4d8a-a07b-03eac5f47f76 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:45.624859 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-3631060c-f480-4d8a-a07b-03eac5f47f76 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:45.656176 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3631060c-f480-4d8a-a07b-03eac5f47f76 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:45.657611 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3631060c-f480-4d8a-a07b-03eac5f47f76 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:45.658793 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3631060c-f480-4d8a-a07b-03eac5f47f76 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:45.659780 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3631060c-f480-4d8a-a07b-03eac5f47f76 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:45.660681 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-c7d49a40-e39d-4414-9da7-f6c713b30dfd req-36cc81b9-a2d7-46be-922f-f50e52c9be16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f88418d-5f96-4c05-adf4-09d83f045699", "tag": "082490a4-d27d-40c5-93fa-92a28b71e068"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:39:45.675232 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-c7d49a40-e39d-4414-9da7-f6c713b30dfd req-36cc81b9-a2d7-46be-922f-f50e52c9be16 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:45.676541 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-c7d49a40-e39d-4414-9da7-f6c713b30dfd req-36cc81b9-a2d7-46be-922f-f50e52c9be16 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:45.708861 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-c7d49a40-e39d-4414-9da7-f6c713b30dfd req-36cc81b9-a2d7-46be-922f-f50e52c9be16 service nova] Creating event network-changed:082490a4-d27d-40c5-93fa-92a28b71e068 for instance 7f88418d-5f96-4c05-adf4-09d83f045699 on hv-cinder-84875 Jul 12 17:39:45.718197 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-c7d49a40-e39d-4414-9da7-f6c713b30dfd req-36cc81b9-a2d7-46be-922f-f50e52c9be16 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066265 Jul 12 17:39:45.719666 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 33/57] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:39:45.859787 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-3631060c-f480-4d8a-a07b-03eac5f47f76 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:45.870360 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-3631060c-f480-4d8a-a07b-03eac5f47f76 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1321 microversion: 2.1 time: 0.254362 Jul 12 17:39:45.878244 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 25/58] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:45 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:46.174105 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-6576b304-daaf-4266-8486-485e16c04883 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:46.175368 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-6576b304-daaf-4266-8486-485e16c04883 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:46.194259 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6576b304-daaf-4266-8486-485e16c04883 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:46.196528 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6576b304-daaf-4266-8486-485e16c04883 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:46.196528 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6576b304-daaf-4266-8486-485e16c04883 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:46.197500 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6576b304-daaf-4266-8486-485e16c04883 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:46.303415 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-6dda8462-dd12-4549-84b2-63e50be5347a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:46.303415 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-6dda8462-dd12-4549-84b2-63e50be5347a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:46.317413 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6dda8462-dd12-4549-84b2-63e50be5347a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:46.320342 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6dda8462-dd12-4549-84b2-63e50be5347a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:46.322064 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6dda8462-dd12-4549-84b2-63e50be5347a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:46.327792 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6dda8462-dd12-4549-84b2-63e50be5347a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:46.524999 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-6576b304-daaf-4266-8486-485e16c04883 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:46.537719 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-6576b304-daaf-4266-8486-485e16c04883 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 200 len: 1366 microversion: 2.1 time: 0.370778 Jul 12 17:39:46.543115 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 34/59] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:46 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 1366 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:46.578775 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-65d69c51-3712-4454-a898-9913d71eeb31 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:46.580092 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-65d69c51-3712-4454-a898-9913d71eeb31 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:46.587308 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-65d69c51-3712-4454-a898-9913d71eeb31 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:46.588339 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-65d69c51-3712-4454-a898-9913d71eeb31 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:46.589360 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-65d69c51-3712-4454-a898-9913d71eeb31 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:46.590231 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-65d69c51-3712-4454-a898-9913d71eeb31 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:46.611303 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-6dda8462-dd12-4549-84b2-63e50be5347a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:46.625078 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-6dda8462-dd12-4549-84b2-63e50be5347a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:46.643057 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-6dda8462-dd12-4549-84b2-63e50be5347a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:46.648528 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-6dda8462-dd12-4549-84b2-63e50be5347a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1404 microversion: 2.20 time: 0.363805 Jul 12 17:39:46.649798 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 26/60] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:39:46 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1404 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:39:46.836926 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-65d69c51-3712-4454-a898-9913d71eeb31 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:46.845645 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-65d69c51-3712-4454-a898-9913d71eeb31 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1315 microversion: 2.1 time: 0.301080 Jul 12 17:39:46.846758 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 35/61] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:46 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:46.892377 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-83c083b2-3671-4b61-8bb3-98cf5c039eb1 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:46.893245 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-83c083b2-3671-4b61-8bb3-98cf5c039eb1 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:46.902089 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-83c083b2-3671-4b61-8bb3-98cf5c039eb1 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:46.902714 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-83c083b2-3671-4b61-8bb3-98cf5c039eb1 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:46.903719 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-83c083b2-3671-4b61-8bb3-98cf5c039eb1 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:46.904472 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-83c083b2-3671-4b61-8bb3-98cf5c039eb1 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:47.075702 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-83c083b2-3671-4b61-8bb3-98cf5c039eb1 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:47.083950 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-83c083b2-3671-4b61-8bb3-98cf5c039eb1 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1321 microversion: 2.1 time: 0.197808 Jul 12 17:39:47.084544 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 27/62] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:46 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:47.565814 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-7255e890-6ce6-4ee5-ac39-08404d417771 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:47.567085 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-7255e890-6ce6-4ee5-ac39-08404d417771 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:47.587068 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7255e890-6ce6-4ee5-ac39-08404d417771 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:47.588047 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7255e890-6ce6-4ee5-ac39-08404d417771 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:47.595546 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7255e890-6ce6-4ee5-ac39-08404d417771 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:47.596150 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7255e890-6ce6-4ee5-ac39-08404d417771 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:47.669509 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-ac361424-2caf-4cc3-9b19-54e033f30e84 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:47.670243 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-ac361424-2caf-4cc3-9b19-54e033f30e84 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:47.678097 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ac361424-2caf-4cc3-9b19-54e033f30e84 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:47.678716 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ac361424-2caf-4cc3-9b19-54e033f30e84 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:47.679574 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ac361424-2caf-4cc3-9b19-54e033f30e84 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:47.680065 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ac361424-2caf-4cc3-9b19-54e033f30e84 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:47.863762 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-7255e890-6ce6-4ee5-ac39-08404d417771 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:47.871548 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ac361424-2caf-4cc3-9b19-54e033f30e84 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:47.882188 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-7255e890-6ce6-4ee5-ac39-08404d417771 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 200 len: 1366 microversion: 2.1 time: 0.327933 Jul 12 17:39:47.885036 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ac361424-2caf-4cc3-9b19-54e033f30e84 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:47.886682 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 36/63] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:47 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:47.887933 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ac361424-2caf-4cc3-9b19-54e033f30e84 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:47.889616 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-ac361424-2caf-4cc3-9b19-54e033f30e84 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1404 microversion: 2.20 time: 0.225715 Jul 12 17:39:47.890273 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 28/64] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:39:47 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1404 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:39:47.905789 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-c073f71d-0ba6-4c78-8edd-471538338f16 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:47.906557 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-c073f71d-0ba6-4c78-8edd-471538338f16 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:47.913311 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c073f71d-0ba6-4c78-8edd-471538338f16 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:47.913753 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c073f71d-0ba6-4c78-8edd-471538338f16 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:47.914615 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c073f71d-0ba6-4c78-8edd-471538338f16 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:47.915054 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c073f71d-0ba6-4c78-8edd-471538338f16 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:48.059580 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-c073f71d-0ba6-4c78-8edd-471538338f16 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:48.067664 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-c073f71d-0ba6-4c78-8edd-471538338f16 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1315 microversion: 2.1 time: 0.179532 Jul 12 17:39:48.068228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 37/65] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:47 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:48.100352 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b27df9d0-a908-4daf-97f6-2928784d723d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:48.101193 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-b27df9d0-a908-4daf-97f6-2928784d723d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:48.104734 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell0:SELECT=8 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:39:48.108670 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b27df9d0-a908-4daf-97f6-2928784d723d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:48.109121 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b27df9d0-a908-4daf-97f6-2928784d723d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:48.110163 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b27df9d0-a908-4daf-97f6-2928784d723d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:48.110730 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b27df9d0-a908-4daf-97f6-2928784d723d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:48.286973 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-b27df9d0-a908-4daf-97f6-2928784d723d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:48.294550 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-b27df9d0-a908-4daf-97f6-2928784d723d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1321 microversion: 2.1 time: 0.198050 Jul 12 17:39:48.295749 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 29/66] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:48 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:48.909772 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-59b93bef-8f9e-4a41-84ad-4b7bd2f0d647 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:48.910710 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-59b93bef-8f9e-4a41-84ad-4b7bd2f0d647 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:48.911426 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-de5b07e9-7e1f-44f3-a5df-ff5d1dd6d0fb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:48.912547 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-de5b07e9-7e1f-44f3-a5df-ff5d1dd6d0fb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:48.917466 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-59b93bef-8f9e-4a41-84ad-4b7bd2f0d647 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:48.918207 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-59b93bef-8f9e-4a41-84ad-4b7bd2f0d647 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:48.919035 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-59b93bef-8f9e-4a41-84ad-4b7bd2f0d647 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:48.919477 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-59b93bef-8f9e-4a41-84ad-4b7bd2f0d647 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:48.922170 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-de5b07e9-7e1f-44f3-a5df-ff5d1dd6d0fb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:48.923151 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-de5b07e9-7e1f-44f3-a5df-ff5d1dd6d0fb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:48.923951 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-de5b07e9-7e1f-44f3-a5df-ff5d1dd6d0fb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:48.924390 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-de5b07e9-7e1f-44f3-a5df-ff5d1dd6d0fb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:48.941993 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell0:SELECT=6 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:39:49.116938 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-59b93bef-8f9e-4a41-84ad-4b7bd2f0d647 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:49.125111 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-59b93bef-8f9e-4a41-84ad-4b7bd2f0d647 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 200 len: 1366 microversion: 2.1 time: 0.219200 Jul 12 17:39:49.135473 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 30/67] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:48 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:39:49.137954 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-de5b07e9-7e1f-44f3-a5df-ff5d1dd6d0fb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:49.141553 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-7c77bd16-66df-48f2-b89a-21cb6774aaa0 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:49.142628 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-7c77bd16-66df-48f2-b89a-21cb6774aaa0 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:49.149789 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-de5b07e9-7e1f-44f3-a5df-ff5d1dd6d0fb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:49.151103 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7c77bd16-66df-48f2-b89a-21cb6774aaa0 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:49.151933 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7c77bd16-66df-48f2-b89a-21cb6774aaa0 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:49.152243 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-de5b07e9-7e1f-44f3-a5df-ff5d1dd6d0fb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:49.153194 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7c77bd16-66df-48f2-b89a-21cb6774aaa0 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:49.153601 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-de5b07e9-7e1f-44f3-a5df-ff5d1dd6d0fb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1404 microversion: 2.20 time: 0.247789 Jul 12 17:39:49.154730 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7c77bd16-66df-48f2-b89a-21cb6774aaa0 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:49.166189 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 38/68] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:39:48 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1404 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:39:49.312615 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-384f7cb0-3038-4677-aadb-30890bbf8956 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:49.313229 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-384f7cb0-3038-4677-aadb-30890bbf8956 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:49.320297 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-384f7cb0-3038-4677-aadb-30890bbf8956 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:49.320754 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-384f7cb0-3038-4677-aadb-30890bbf8956 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:49.321523 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-384f7cb0-3038-4677-aadb-30890bbf8956 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:49.321993 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-384f7cb0-3038-4677-aadb-30890bbf8956 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:49.337793 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-7c77bd16-66df-48f2-b89a-21cb6774aaa0 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:49.349036 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-7c77bd16-66df-48f2-b89a-21cb6774aaa0 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1315 microversion: 2.1 time: 0.212336 Jul 12 17:39:49.349673 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 31/69] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:49 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:49.553263 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-384f7cb0-3038-4677-aadb-30890bbf8956 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:49.561236 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-384f7cb0-3038-4677-aadb-30890bbf8956 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1321 microversion: 2.1 time: 0.253141 Jul 12 17:39:49.561841 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 39/70] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:49 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:39:50.143279 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-0ed879f8-e6a0-456d-ba3b-b11b72040cf7 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:50.143988 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-0ed879f8-e6a0-456d-ba3b-b11b72040cf7 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:50.150758 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ed879f8-e6a0-456d-ba3b-b11b72040cf7 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:50.151214 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ed879f8-e6a0-456d-ba3b-b11b72040cf7 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:50.151991 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ed879f8-e6a0-456d-ba3b-b11b72040cf7 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:50.159968 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ed879f8-e6a0-456d-ba3b-b11b72040cf7 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:50.172816 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-f51c3e2c-0bab-46a9-83a5-f112dd0e9367 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:50.173753 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-f51c3e2c-0bab-46a9-83a5-f112dd0e9367 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:50.186307 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f51c3e2c-0bab-46a9-83a5-f112dd0e9367 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:50.186994 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f51c3e2c-0bab-46a9-83a5-f112dd0e9367 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:50.188039 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f51c3e2c-0bab-46a9-83a5-f112dd0e9367 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:50.188709 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f51c3e2c-0bab-46a9-83a5-f112dd0e9367 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:50.534030 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-f51c3e2c-0bab-46a9-83a5-f112dd0e9367 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:50.547318 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-f51c3e2c-0bab-46a9-83a5-f112dd0e9367 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:50.554468 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-f51c3e2c-0bab-46a9-83a5-f112dd0e9367 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:50.556945 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-f51c3e2c-0bab-46a9-83a5-f112dd0e9367 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1404 microversion: 2.20 time: 0.386908 Jul 12 17:39:50.556945 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 40/71] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:39:50 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1404 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:39:50.571307 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-f838c8d5-c349-4fec-b15e-41ffaa7db7aa tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:50.572198 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-f838c8d5-c349-4fec-b15e-41ffaa7db7aa tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:50.581335 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f838c8d5-c349-4fec-b15e-41ffaa7db7aa tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:50.581945 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f838c8d5-c349-4fec-b15e-41ffaa7db7aa tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:50.583476 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f838c8d5-c349-4fec-b15e-41ffaa7db7aa tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:50.584067 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f838c8d5-c349-4fec-b15e-41ffaa7db7aa tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:50.796098 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0ed879f8-e6a0-456d-ba3b-b11b72040cf7 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:50.811509 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-f838c8d5-c349-4fec-b15e-41ffaa7db7aa tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:50.818244 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-0ed879f8-e6a0-456d-ba3b-b11b72040cf7 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 200 len: 1366 microversion: 2.1 time: 0.679532 Jul 12 17:39:50.819294 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 32/72] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:50 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 1366 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:39:50.825946 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-5d7c38d2-d09d-47ec-866b-c126c2268ae8 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:50.828463 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-5d7c38d2-d09d-47ec-866b-c126c2268ae8 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:50.829270 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-f838c8d5-c349-4fec-b15e-41ffaa7db7aa tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1315 microversion: 2.1 time: 0.265181 Jul 12 17:39:50.839146 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 41/73] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:50 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:50.845494 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5d7c38d2-d09d-47ec-866b-c126c2268ae8 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:50.845494 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5d7c38d2-d09d-47ec-866b-c126c2268ae8 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:50.845805 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5d7c38d2-d09d-47ec-866b-c126c2268ae8 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:50.846554 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5d7c38d2-d09d-47ec-866b-c126c2268ae8 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:51.265277 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-5d7c38d2-d09d-47ec-866b-c126c2268ae8 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:51.267914 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-5d7c38d2-d09d-47ec-866b-c126c2268ae8 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1321 microversion: 2.1 time: 0.447177 Jul 12 17:39:51.268758 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 33/74] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:50 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1321 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:51.584643 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-395bca6a-0a1a-4deb-8b2f-b0c765dfe29a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:51.586023 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-395bca6a-0a1a-4deb-8b2f-b0c765dfe29a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:51.595002 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-395bca6a-0a1a-4deb-8b2f-b0c765dfe29a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:51.595696 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-395bca6a-0a1a-4deb-8b2f-b0c765dfe29a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:51.596767 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-395bca6a-0a1a-4deb-8b2f-b0c765dfe29a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:51.598585 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-395bca6a-0a1a-4deb-8b2f-b0c765dfe29a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:51.822988 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-395bca6a-0a1a-4deb-8b2f-b0c765dfe29a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:51.835134 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-27690e07-196d-4e60-be55-4c2d48eaf8fd tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:51.835752 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-27690e07-196d-4e60-be55-4c2d48eaf8fd tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:51.839851 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-395bca6a-0a1a-4deb-8b2f-b0c765dfe29a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:51.844318 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-27690e07-196d-4e60-be55-4c2d48eaf8fd tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:51.844649 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-395bca6a-0a1a-4deb-8b2f-b0c765dfe29a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:51.844767 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-27690e07-196d-4e60-be55-4c2d48eaf8fd tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:51.846098 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-27690e07-196d-4e60-be55-4c2d48eaf8fd tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:51.846516 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-395bca6a-0a1a-4deb-8b2f-b0c765dfe29a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1404 microversion: 2.20 time: 0.271601 Jul 12 17:39:51.852172 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-27690e07-196d-4e60-be55-4c2d48eaf8fd tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:51.852313 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 42/75] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:39:51 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1404 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:39:51.858880 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-8745f032-36a1-4d00-953c-013c528d9e52 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:51.859832 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-8745f032-36a1-4d00-953c-013c528d9e52 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:51.867547 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8745f032-36a1-4d00-953c-013c528d9e52 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:51.868008 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8745f032-36a1-4d00-953c-013c528d9e52 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:51.869121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8745f032-36a1-4d00-953c-013c528d9e52 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:51.869570 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8745f032-36a1-4d00-953c-013c528d9e52 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:52.032068 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-27690e07-196d-4e60-be55-4c2d48eaf8fd tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:52.039810 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-27690e07-196d-4e60-be55-4c2d48eaf8fd tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 200 len: 1366 microversion: 2.1 time: 0.208485 Jul 12 17:39:52.043312 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 34/76] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:51 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:39:52.053487 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-8745f032-36a1-4d00-953c-013c528d9e52 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:52.062265 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-8745f032-36a1-4d00-953c-013c528d9e52 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1315 microversion: 2.1 time: 0.212927 Jul 12 17:39:52.062984 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 43/77] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:51 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:52.285796 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-bfacacce-9712-44ba-8ecc-cc4612b3fe23 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:52.286809 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-bfacacce-9712-44ba-8ecc-cc4612b3fe23 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:52.293742 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bfacacce-9712-44ba-8ecc-cc4612b3fe23 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:52.294290 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bfacacce-9712-44ba-8ecc-cc4612b3fe23 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:52.295153 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bfacacce-9712-44ba-8ecc-cc4612b3fe23 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:52.295730 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bfacacce-9712-44ba-8ecc-cc4612b3fe23 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:52.653551 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-bfacacce-9712-44ba-8ecc-cc4612b3fe23 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:52.680288 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-bfacacce-9712-44ba-8ecc-cc4612b3fe23 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1321 microversion: 2.1 time: 0.398004 Jul 12 17:39:52.710222 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 35/78] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:52 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1321 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:52.865934 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-93442a99-205f-45c0-ac9d-6b4926780915 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:52.867070 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-93442a99-205f-45c0-ac9d-6b4926780915 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:52.874169 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-93442a99-205f-45c0-ac9d-6b4926780915 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:52.874811 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-93442a99-205f-45c0-ac9d-6b4926780915 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:52.875710 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-93442a99-205f-45c0-ac9d-6b4926780915 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:52.876567 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-93442a99-205f-45c0-ac9d-6b4926780915 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:53.057217 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-887c0899-5f80-4313-9ef9-1e6b6d3d994f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:53.063022 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-887c0899-5f80-4313-9ef9-1e6b6d3d994f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:53.065710 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-887c0899-5f80-4313-9ef9-1e6b6d3d994f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:53.066334 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-887c0899-5f80-4313-9ef9-1e6b6d3d994f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:53.067630 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-887c0899-5f80-4313-9ef9-1e6b6d3d994f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:53.068086 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-887c0899-5f80-4313-9ef9-1e6b6d3d994f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:53.072309 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-93442a99-205f-45c0-ac9d-6b4926780915 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:53.087186 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-93442a99-205f-45c0-ac9d-6b4926780915 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:53.089433 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-93442a99-205f-45c0-ac9d-6b4926780915 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:53.091159 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-93442a99-205f-45c0-ac9d-6b4926780915 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1404 microversion: 2.20 time: 0.229503 Jul 12 17:39:53.093042 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 44/79] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:39:52 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1404 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:39:53.099128 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-2010272b-c593-4ad0-928d-b5a5be5b9807 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:53.099758 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-2010272b-c593-4ad0-928d-b5a5be5b9807 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:53.106654 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2010272b-c593-4ad0-928d-b5a5be5b9807 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:53.107669 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2010272b-c593-4ad0-928d-b5a5be5b9807 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:53.108669 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2010272b-c593-4ad0-928d-b5a5be5b9807 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:53.110312 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2010272b-c593-4ad0-928d-b5a5be5b9807 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:53.289577 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-887c0899-5f80-4313-9ef9-1e6b6d3d994f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:53.306376 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-887c0899-5f80-4313-9ef9-1e6b6d3d994f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 200 len: 1366 microversion: 2.1 time: 0.249755 Jul 12 17:39:53.307580 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 36/80] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:53 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:39:53.342753 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-2010272b-c593-4ad0-928d-b5a5be5b9807 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:53.351705 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-2010272b-c593-4ad0-928d-b5a5be5b9807 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1315 microversion: 2.1 time: 0.257131 Jul 12 17:39:53.355949 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 45/81] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:53 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:53.402320 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-1889760a-474b-4f9e-8b7f-522bba80c6f7 req-2dbe897c-44c2-4164-818a-c1e36059e67d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c50a610-ffbb-40cc-b1d3-b05a598c7e3a", "name": "network-vif-plugged", "status": "completed", "tag": "5f828fa0-9a14-4714-96d9-422ef2b20526"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:39:53.411616 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-1889760a-474b-4f9e-8b7f-522bba80c6f7 req-2dbe897c-44c2-4164-818a-c1e36059e67d service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:53.412066 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-1889760a-474b-4f9e-8b7f-522bba80c6f7 req-2dbe897c-44c2-4164-818a-c1e36059e67d service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:53.424955 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-1889760a-474b-4f9e-8b7f-522bba80c6f7 req-2dbe897c-44c2-4164-818a-c1e36059e67d service nova] Creating event network-vif-plugged:5f828fa0-9a14-4714-96d9-422ef2b20526 for instance 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a on hv-cinder-84875 Jul 12 17:39:53.430188 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-1889760a-474b-4f9e-8b7f-522bba80c6f7 req-2dbe897c-44c2-4164-818a-c1e36059e67d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107520 Jul 12 17:39:53.430838 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 37/82] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:39:53.714708 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-8803c58e-184b-4613-b4b9-12be0272f026 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:53.715304 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-8803c58e-184b-4613-b4b9-12be0272f026 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:53.723728 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8803c58e-184b-4613-b4b9-12be0272f026 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:53.724186 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8803c58e-184b-4613-b4b9-12be0272f026 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:53.724971 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8803c58e-184b-4613-b4b9-12be0272f026 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:53.725576 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8803c58e-184b-4613-b4b9-12be0272f026 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:53.927241 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-8803c58e-184b-4613-b4b9-12be0272f026 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:53.940083 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-8803c58e-184b-4613-b4b9-12be0272f026 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1321 microversion: 2.1 time: 0.227296 Jul 12 17:39:53.949338 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 46/83] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:53 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:54.110976 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-99fa9a9f-b05c-46b3-ae08-a9566f82433d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:54.111685 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-99fa9a9f-b05c-46b3-ae08-a9566f82433d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:54.118805 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-99fa9a9f-b05c-46b3-ae08-a9566f82433d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:54.119265 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-99fa9a9f-b05c-46b3-ae08-a9566f82433d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:54.120068 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-99fa9a9f-b05c-46b3-ae08-a9566f82433d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:54.120673 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-99fa9a9f-b05c-46b3-ae08-a9566f82433d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:54.325896 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-254de087-a14b-4399-870e-35452f679b01 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:54.326530 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-254de087-a14b-4399-870e-35452f679b01 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:54.333268 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-254de087-a14b-4399-870e-35452f679b01 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:54.333866 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-254de087-a14b-4399-870e-35452f679b01 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:54.334681 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-254de087-a14b-4399-870e-35452f679b01 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:54.338139 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-254de087-a14b-4399-870e-35452f679b01 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:54.374924 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=100 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:39:54.493213 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-99fa9a9f-b05c-46b3-ae08-a9566f82433d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:54.511262 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-99fa9a9f-b05c-46b3-ae08-a9566f82433d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:54.517296 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-99fa9a9f-b05c-46b3-ae08-a9566f82433d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:54.519306 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-99fa9a9f-b05c-46b3-ae08-a9566f82433d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1404 microversion: 2.20 time: 0.412849 Jul 12 17:39:54.521297 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 38/84] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:39:54 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1404 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:39:54.527079 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-155d5ab3-2de9-4048-bec4-d2a74f51f38c tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:54.527702 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-155d5ab3-2de9-4048-bec4-d2a74f51f38c tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:54.534789 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-155d5ab3-2de9-4048-bec4-d2a74f51f38c tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:54.536296 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-155d5ab3-2de9-4048-bec4-d2a74f51f38c tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:54.537270 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-155d5ab3-2de9-4048-bec4-d2a74f51f38c tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:54.537877 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-155d5ab3-2de9-4048-bec4-d2a74f51f38c tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:54.559026 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-254de087-a14b-4399-870e-35452f679b01 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:54.566996 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-254de087-a14b-4399-870e-35452f679b01 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 200 len: 1366 microversion: 2.1 time: 0.245744 Jul 12 17:39:54.568190 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 47/85] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:54 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:39:54.832930 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-155d5ab3-2de9-4048-bec4-d2a74f51f38c tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:54.840598 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-155d5ab3-2de9-4048-bec4-d2a74f51f38c tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1315 microversion: 2.1 time: 0.317903 Jul 12 17:39:54.841729 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 39/86] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:54 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:54.956485 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-14c83b6a-7c4b-41dd-aac7-273e67c9606e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:54.957818 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-14c83b6a-7c4b-41dd-aac7-273e67c9606e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:54.963553 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-14c83b6a-7c4b-41dd-aac7-273e67c9606e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:54.964208 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-14c83b6a-7c4b-41dd-aac7-273e67c9606e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:54.964781 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-14c83b6a-7c4b-41dd-aac7-273e67c9606e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:54.965220 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-14c83b6a-7c4b-41dd-aac7-273e67c9606e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:55.136746 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-14c83b6a-7c4b-41dd-aac7-273e67c9606e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:55.156761 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-14c83b6a-7c4b-41dd-aac7-273e67c9606e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1321 microversion: 2.1 time: 0.204436 Jul 12 17:39:55.158169 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 48/87] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:54 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:55.230047 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-2d9190ad-70c7-4a3d-ada6-1711cc1547f6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2021514703", "imageRef": "cb077f42-97cd-41cf-8758-764c562534f4", "flavorRef": "452", "networks": [{"uuid": "fa38e137-0886-4f9b-8fe4-1e7fbf99c447"}]}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:39:55.327136 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.network.neutron [None req-2d9190ad-70c7-4a3d-ada6-1711cc1547f6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] validate_networks() for [('fa38e137-0886-4f9b-8fe4-1e7fbf99c447', None, None, None, None, None)] {{(pid=130058) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:39:55.463877 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-20067f96-8815-4538-925b-6e96e3adf324 req-f7edb311-bbb1-482f-825d-d5a0e7ef9936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64", "name": "network-vif-plugged", "status": "completed", "tag": "1ff07e21-5b8b-4e11-aaf6-3fff31f7dbba"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:39:55.475438 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-20067f96-8815-4538-925b-6e96e3adf324 req-f7edb311-bbb1-482f-825d-d5a0e7ef9936 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:55.475946 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-20067f96-8815-4538-925b-6e96e3adf324 req-f7edb311-bbb1-482f-825d-d5a0e7ef9936 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:55.489590 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-20067f96-8815-4538-925b-6e96e3adf324 req-f7edb311-bbb1-482f-825d-d5a0e7ef9936 service nova] Creating event network-vif-plugged:1ff07e21-5b8b-4e11-aaf6-3fff31f7dbba for instance 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 on hv-cinder-84875 Jul 12 17:39:55.495500 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-20067f96-8815-4538-925b-6e96e3adf324 req-f7edb311-bbb1-482f-825d-d5a0e7ef9936 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037188 Jul 12 17:39:55.496807 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 49/88] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:39:55.550355 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a20c48a1-8dfd-492a-b3bc-900eb0d6c724 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:55.551578 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-a20c48a1-8dfd-492a-b3bc-900eb0d6c724 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:55.586110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a20c48a1-8dfd-492a-b3bc-900eb0d6c724 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:55.586650 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a20c48a1-8dfd-492a-b3bc-900eb0d6c724 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:55.587512 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a20c48a1-8dfd-492a-b3bc-900eb0d6c724 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:55.588169 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a20c48a1-8dfd-492a-b3bc-900eb0d6c724 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:55.855116 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a20c48a1-8dfd-492a-b3bc-900eb0d6c724 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:55.870892 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a20c48a1-8dfd-492a-b3bc-900eb0d6c724 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:55.873190 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a20c48a1-8dfd-492a-b3bc-900eb0d6c724 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:55.874411 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-a20c48a1-8dfd-492a-b3bc-900eb0d6c724 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1404 microversion: 2.20 time: 0.332116 Jul 12 17:39:55.887102 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-2d9190ad-70c7-4a3d-ada6-1711cc1547f6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Flavor limits 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:39:55.887102 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-2d9190ad-70c7-4a3d-ada6-1711cc1547f6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Image limits 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:39:55.887102 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-2d9190ad-70c7-4a3d-ada6-1711cc1547f6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Flavor pref 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:39:55.887102 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-2d9190ad-70c7-4a3d-ada6-1711cc1547f6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Image pref 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:39:55.887102 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-2d9190ad-70c7-4a3d-ada6-1711cc1547f6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:39:55.888490 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 50/89] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:39:55 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1404 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:39:55.890713 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-0586de03-e7d6-42d5-8137-d62e27887f3c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:55.891327 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-0586de03-e7d6-42d5-8137-d62e27887f3c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:55.897541 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0586de03-e7d6-42d5-8137-d62e27887f3c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:55.897997 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0586de03-e7d6-42d5-8137-d62e27887f3c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:55.898123 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2d9190ad-70c7-4a3d-ada6-1711cc1547f6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:55.898691 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2d9190ad-70c7-4a3d-ada6-1711cc1547f6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:55.898903 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0586de03-e7d6-42d5-8137-d62e27887f3c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:55.899348 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0586de03-e7d6-42d5-8137-d62e27887f3c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:55.900223 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2d9190ad-70c7-4a3d-ada6-1711cc1547f6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:55.900848 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2d9190ad-70c7-4a3d-ada6-1711cc1547f6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:55.923276 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-2d9190ad-70c7-4a3d-ada6-1711cc1547f6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Getting quotas for project b3cb433fc8c44c87a642aaa9011ff624. Resources: {'cores', 'instances', 'ram'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:39:55.928392 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-2d9190ad-70c7-4a3d-ada6-1711cc1547f6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Getting quotas for user 2c4deca7942842759f795ab5299b44a3 and project b3cb433fc8c44c87a642aaa9011ff624. Resources: {'cores', 'instances', 'ram'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:39:55.945625 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-2d9190ad-70c7-4a3d-ada6-1711cc1547f6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Going to run 1 instances... {{(pid=130058) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:39:55.948284 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-2d9190ad-70c7-4a3d-ada6-1711cc1547f6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb077f42-97cd-41cf-8758-764c562534f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:39:56.152127 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-2d9190ad-70c7-4a3d-ada6-1711cc1547f6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.929731 Jul 12 17:39:56.158411 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 40/90] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 12 17:39:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:39:56.164231 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-0586de03-e7d6-42d5-8137-d62e27887f3c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:56.169246 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-6acf447b-223b-4dc2-ab85-7cf627f072ae tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:56.169922 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-6acf447b-223b-4dc2-ab85-7cf627f072ae tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:56.179595 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-0586de03-e7d6-42d5-8137-d62e27887f3c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 200 len: 1366 microversion: 2.1 time: 0.291531 Jul 12 17:39:56.183416 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 51/91] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:55 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:56.183917 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6acf447b-223b-4dc2-ab85-7cf627f072ae tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:56.194916 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-034a63bf-18e6-4a2d-8112-9858ccf07153 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:56.194916 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-034a63bf-18e6-4a2d-8112-9858ccf07153 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:56.195150 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6acf447b-223b-4dc2-ab85-7cf627f072ae tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:56.195992 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6acf447b-223b-4dc2-ab85-7cf627f072ae tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:56.197318 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6acf447b-223b-4dc2-ab85-7cf627f072ae tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:56.226095 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=100 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:39:56.266146 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-034a63bf-18e6-4a2d-8112-9858ccf07153 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:56.282365 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-034a63bf-18e6-4a2d-8112-9858ccf07153 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1214 microversion: 2.1 time: 0.091712 Jul 12 17:39:56.282365 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 52/92] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:56 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:56.288953 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ac03b354-4f23-415b-b888-75639b3c2ae0 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:56.289625 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-ac03b354-4f23-415b-b888-75639b3c2ae0 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:56.302655 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ac03b354-4f23-415b-b888-75639b3c2ae0 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:56.304226 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ac03b354-4f23-415b-b888-75639b3c2ae0 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:56.312595 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ac03b354-4f23-415b-b888-75639b3c2ae0 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:56.313109 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ac03b354-4f23-415b-b888-75639b3c2ae0 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:56.483354 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-ac03b354-4f23-415b-b888-75639b3c2ae0 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:56.492165 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-ac03b354-4f23-415b-b888-75639b3c2ae0 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1321 microversion: 2.1 time: 0.215883 Jul 12 17:39:56.492752 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 53/93] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:56 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:56.557705 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-6acf447b-223b-4dc2-ab85-7cf627f072ae tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:56.567927 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-6acf447b-223b-4dc2-ab85-7cf627f072ae tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1315 microversion: 2.1 time: 0.402912 Jul 12 17:39:56.568961 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 41/94] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:56 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:56.900538 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-3f169a0f-4d2a-484b-9070-8cd5aed92bd5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:56.906055 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-3f169a0f-4d2a-484b-9070-8cd5aed92bd5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:56.931228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3f169a0f-4d2a-484b-9070-8cd5aed92bd5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:56.933439 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3f169a0f-4d2a-484b-9070-8cd5aed92bd5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:56.935925 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3f169a0f-4d2a-484b-9070-8cd5aed92bd5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:56.936580 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3f169a0f-4d2a-484b-9070-8cd5aed92bd5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:57.201359 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-3f169a0f-4d2a-484b-9070-8cd5aed92bd5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:57.204752 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-c6e52945-8093-4b0d-a2b4-9f11a4826892 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:57.206903 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-c6e52945-8093-4b0d-a2b4-9f11a4826892 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:57.214536 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-3f169a0f-4d2a-484b-9070-8cd5aed92bd5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:57.216961 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-3f169a0f-4d2a-484b-9070-8cd5aed92bd5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:57.218846 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-3f169a0f-4d2a-484b-9070-8cd5aed92bd5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1404 microversion: 2.20 time: 0.329164 Jul 12 17:39:57.221782 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c6e52945-8093-4b0d-a2b4-9f11a4826892 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:57.221910 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 54/95] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:39:56 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1404 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:39:57.227709 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c6e52945-8093-4b0d-a2b4-9f11a4826892 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:57.230050 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c6e52945-8093-4b0d-a2b4-9f11a4826892 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:57.230931 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c6e52945-8093-4b0d-a2b4-9f11a4826892 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:57.292145 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-4d14b893-918e-4e09-aa9d-827961138fde tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:57.293035 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-4d14b893-918e-4e09-aa9d-827961138fde tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:57.372083 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-4d14b893-918e-4e09-aa9d-827961138fde tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:57.380857 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-4d14b893-918e-4e09-aa9d-827961138fde tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1214 microversion: 2.1 time: 0.092577 Jul 12 17:39:57.381448 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 55/96] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:57 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:39:57.406667 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-c6e52945-8093-4b0d-a2b4-9f11a4826892 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:57.414811 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-c6e52945-8093-4b0d-a2b4-9f11a4826892 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 200 len: 1366 microversion: 2.1 time: 0.216217 Jul 12 17:39:57.415437 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 42/97] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:57 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:39:57.510949 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-5efcc5e6-c696-4e32-b01b-2e83fe50a58b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:57.511856 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-5efcc5e6-c696-4e32-b01b-2e83fe50a58b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:57.518041 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5efcc5e6-c696-4e32-b01b-2e83fe50a58b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:57.518535 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5efcc5e6-c696-4e32-b01b-2e83fe50a58b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:57.519335 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5efcc5e6-c696-4e32-b01b-2e83fe50a58b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:57.519778 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5efcc5e6-c696-4e32-b01b-2e83fe50a58b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:57.596745 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-9794bafb-d13f-4e5a-8917-d5792e24589b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:57.597939 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-9794bafb-d13f-4e5a-8917-d5792e24589b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:57.609543 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9794bafb-d13f-4e5a-8917-d5792e24589b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:57.610341 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9794bafb-d13f-4e5a-8917-d5792e24589b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:57.611771 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9794bafb-d13f-4e5a-8917-d5792e24589b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:57.612672 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9794bafb-d13f-4e5a-8917-d5792e24589b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:57.682129 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-5efcc5e6-c696-4e32-b01b-2e83fe50a58b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:57.695571 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-5efcc5e6-c696-4e32-b01b-2e83fe50a58b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1321 microversion: 2.1 time: 0.184897 Jul 12 17:39:57.695571 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 56/98] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:57 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:39:57.814870 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-9794bafb-d13f-4e5a-8917-d5792e24589b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:57.823384 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-9794bafb-d13f-4e5a-8917-d5792e24589b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1315 microversion: 2.1 time: 0.234313 Jul 12 17:39:57.833367 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 43/99] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:57 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:58.238373 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-66e6fe1d-4df9-4ec9-a7aa-38f4bd079c32 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:58.239917 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-66e6fe1d-4df9-4ec9-a7aa-38f4bd079c32 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:58.247483 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-66e6fe1d-4df9-4ec9-a7aa-38f4bd079c32 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:58.247938 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-66e6fe1d-4df9-4ec9-a7aa-38f4bd079c32 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:58.248738 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-66e6fe1d-4df9-4ec9-a7aa-38f4bd079c32 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:58.249551 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-66e6fe1d-4df9-4ec9-a7aa-38f4bd079c32 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:58.399133 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-a2763b03-4c2e-4bd9-baad-ffd2434753bf tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:58.399864 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-a2763b03-4c2e-4bd9-baad-ffd2434753bf tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:58.409078 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a2763b03-4c2e-4bd9-baad-ffd2434753bf tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:58.409665 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a2763b03-4c2e-4bd9-baad-ffd2434753bf tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:58.410693 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a2763b03-4c2e-4bd9-baad-ffd2434753bf tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:58.411283 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a2763b03-4c2e-4bd9-baad-ffd2434753bf tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:58.446550 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-66e6fe1d-4df9-4ec9-a7aa-38f4bd079c32 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:58.462189 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-66e6fe1d-4df9-4ec9-a7aa-38f4bd079c32 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:58.465611 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-66e6fe1d-4df9-4ec9-a7aa-38f4bd079c32 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:58.467717 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-66e6fe1d-4df9-4ec9-a7aa-38f4bd079c32 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1404 microversion: 2.20 time: 0.233239 Jul 12 17:39:58.468690 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 57/100] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:39:58 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1404 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:39:58.488363 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-f249b719-59f4-4cd9-bc13-8a83d5b0fe43 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:58.499732 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-f249b719-59f4-4cd9-bc13-8a83d5b0fe43 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:58.503842 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-a2763b03-4c2e-4bd9-baad-ffd2434753bf tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:58.512340 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-a2763b03-4c2e-4bd9-baad-ffd2434753bf tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1218 microversion: 2.1 time: 0.117068 Jul 12 17:39:58.513901 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 44/101] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:58 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1218 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:39:58.535836 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f249b719-59f4-4cd9-bc13-8a83d5b0fe43 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:58.536932 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f249b719-59f4-4cd9-bc13-8a83d5b0fe43 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:58.538107 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f249b719-59f4-4cd9-bc13-8a83d5b0fe43 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:58.539033 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f249b719-59f4-4cd9-bc13-8a83d5b0fe43 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:58.711190 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-0ebea914-9b20-4766-81fc-9991c7881314 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:58.712070 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-0ebea914-9b20-4766-81fc-9991c7881314 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:58.725094 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ebea914-9b20-4766-81fc-9991c7881314 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:58.725094 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ebea914-9b20-4766-81fc-9991c7881314 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:58.725094 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ebea914-9b20-4766-81fc-9991c7881314 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:58.725094 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ebea914-9b20-4766-81fc-9991c7881314 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:58.773141 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-f249b719-59f4-4cd9-bc13-8a83d5b0fe43 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:58.781711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-f249b719-59f4-4cd9-bc13-8a83d5b0fe43 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 200 len: 1366 microversion: 2.1 time: 0.311411 Jul 12 17:39:58.782327 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 58/102] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:58 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:58.840077 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-c092d020-058f-412c-b0a3-805ea4318c25 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:58.840824 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-c092d020-058f-412c-b0a3-805ea4318c25 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:58.854027 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c092d020-058f-412c-b0a3-805ea4318c25 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:58.854667 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c092d020-058f-412c-b0a3-805ea4318c25 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:58.855727 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c092d020-058f-412c-b0a3-805ea4318c25 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:58.856925 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c092d020-058f-412c-b0a3-805ea4318c25 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:58.940582 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0ebea914-9b20-4766-81fc-9991c7881314 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:58.959700 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-0ebea914-9b20-4766-81fc-9991c7881314 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1321 microversion: 2.1 time: 0.251728 Jul 12 17:39:58.969582 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 45/103] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:58 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:59.062093 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-c092d020-058f-412c-b0a3-805ea4318c25 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:59.071999 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-c092d020-058f-412c-b0a3-805ea4318c25 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1315 microversion: 2.1 time: 0.235980 Jul 12 17:39:59.072597 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 59/104] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:58 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:59.253109 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-6ca5d5ad-c68f-4e01-ab9f-3e27d5931a7a req-c63016e6-bb74-47d9-ac29-e56bde5a8c66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "407f15c2-26ad-460c-b4cd-281bc67c5c0d", "name": "network-vif-plugged", "status": "completed", "tag": "51b4a1d7-d75e-4513-9fce-09137564d4ec"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:39:59.271874 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-6ca5d5ad-c68f-4e01-ab9f-3e27d5931a7a req-c63016e6-bb74-47d9-ac29-e56bde5a8c66 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:59.272328 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-6ca5d5ad-c68f-4e01-ab9f-3e27d5931a7a req-c63016e6-bb74-47d9-ac29-e56bde5a8c66 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:59.284834 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-6ca5d5ad-c68f-4e01-ab9f-3e27d5931a7a req-c63016e6-bb74-47d9-ac29-e56bde5a8c66 service nova] Creating event network-vif-plugged:51b4a1d7-d75e-4513-9fce-09137564d4ec for instance 407f15c2-26ad-460c-b4cd-281bc67c5c0d on hv-cinder-84875 Jul 12 17:39:59.290280 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-6ca5d5ad-c68f-4e01-ab9f-3e27d5931a7a req-c63016e6-bb74-47d9-ac29-e56bde5a8c66 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063813 Jul 12 17:39:59.290972 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 46/105] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:39:59.490483 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-74501f0c-21a7-4f9e-a575-53a38eca2b46 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:59.491579 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-74501f0c-21a7-4f9e-a575-53a38eca2b46 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:59.499287 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-74501f0c-21a7-4f9e-a575-53a38eca2b46 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:59.500111 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-74501f0c-21a7-4f9e-a575-53a38eca2b46 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:59.501082 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-74501f0c-21a7-4f9e-a575-53a38eca2b46 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:59.501517 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-74501f0c-21a7-4f9e-a575-53a38eca2b46 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:59.547913 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-fec58c44-5873-4f58-8c0c-6e5f2c208c12 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:59.551622 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-fec58c44-5873-4f58-8c0c-6e5f2c208c12 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:59.570009 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fec58c44-5873-4f58-8c0c-6e5f2c208c12 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:59.570501 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fec58c44-5873-4f58-8c0c-6e5f2c208c12 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:59.571311 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fec58c44-5873-4f58-8c0c-6e5f2c208c12 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:59.571756 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fec58c44-5873-4f58-8c0c-6e5f2c208c12 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:59.647972 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-fec58c44-5873-4f58-8c0c-6e5f2c208c12 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:59.657687 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-fec58c44-5873-4f58-8c0c-6e5f2c208c12 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1210 microversion: 2.1 time: 0.119173 Jul 12 17:39:59.658705 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 47/106] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:59 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1210 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:59.694821 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-74501f0c-21a7-4f9e-a575-53a38eca2b46 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:59.711484 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-74501f0c-21a7-4f9e-a575-53a38eca2b46 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:59.716984 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-74501f0c-21a7-4f9e-a575-53a38eca2b46 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:59.719727 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-74501f0c-21a7-4f9e-a575-53a38eca2b46 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1404 microversion: 2.20 time: 0.236418 Jul 12 17:39:59.723588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 60/107] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:39:59 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1404 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:39:59.802580 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-79aa907f-345c-4015-aa9c-d37ad9a35fb1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:59.804000 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-79aa907f-345c-4015-aa9c-d37ad9a35fb1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:59.827401 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-79aa907f-345c-4015-aa9c-d37ad9a35fb1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:59.828639 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-79aa907f-345c-4015-aa9c-d37ad9a35fb1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:59.830809 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-79aa907f-345c-4015-aa9c-d37ad9a35fb1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:59.834933 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-79aa907f-345c-4015-aa9c-d37ad9a35fb1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:59.977244 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-9d2cc2f8-db38-49c8-961d-f85ad3a499c5 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:59.977952 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-9d2cc2f8-db38-49c8-961d-f85ad3a499c5 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:59.989204 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9d2cc2f8-db38-49c8-961d-f85ad3a499c5 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:59.990068 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9d2cc2f8-db38-49c8-961d-f85ad3a499c5 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:59.991631 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9d2cc2f8-db38-49c8-961d-f85ad3a499c5 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:59.992265 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9d2cc2f8-db38-49c8-961d-f85ad3a499c5 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:00.119261 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-79aa907f-345c-4015-aa9c-d37ad9a35fb1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:00.150611 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-79aa907f-345c-4015-aa9c-d37ad9a35fb1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 200 len: 1366 microversion: 2.1 time: 0.345834 Jul 12 17:40:00.150611 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 48/108] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:59 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 1366 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:40:00.150611 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-ccfc9e25-e8a3-47bb-b802-251cde4acac2 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:00.151835 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-ccfc9e25-e8a3-47bb-b802-251cde4acac2 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:00.163436 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ccfc9e25-e8a3-47bb-b802-251cde4acac2 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:00.164283 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ccfc9e25-e8a3-47bb-b802-251cde4acac2 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:00.165724 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ccfc9e25-e8a3-47bb-b802-251cde4acac2 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:00.166509 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ccfc9e25-e8a3-47bb-b802-251cde4acac2 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:00.219433 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-9d2cc2f8-db38-49c8-961d-f85ad3a499c5 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:00.231206 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-9d2cc2f8-db38-49c8-961d-f85ad3a499c5 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1515 microversion: 2.1 time: 0.257758 Jul 12 17:40:00.236138 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 61/109] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:59 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1515 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:00.255666 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-c7d6da22-e459-4d6b-ae22-fafb27b064b2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:40:00.257167 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-c7d6da22-e459-4d6b-ae22-fafb27b064b2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:00.265788 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c7d6da22-e459-4d6b-ae22-fafb27b064b2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:00.266245 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c7d6da22-e459-4d6b-ae22-fafb27b064b2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:00.267125 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c7d6da22-e459-4d6b-ae22-fafb27b064b2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:00.267568 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c7d6da22-e459-4d6b-ae22-fafb27b064b2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:00.347662 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.objects.instance [None req-c7d6da22-e459-4d6b-ae22-fafb27b064b2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lazy-loading 'flavor' on Instance uuid 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 {{(pid=130059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:40:00.380550 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ccfc9e25-e8a3-47bb-b802-251cde4acac2 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:00.392865 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-ccfc9e25-e8a3-47bb-b802-251cde4acac2 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1315 microversion: 2.1 time: 0.247460 Jul 12 17:40:00.393872 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 49/110] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:00 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:00.678821 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-294e0dc4-a800-4705-8fdb-00791ea4149b tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:00.679533 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-294e0dc4-a800-4705-8fdb-00791ea4149b tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:00.689553 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-294e0dc4-a800-4705-8fdb-00791ea4149b tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:00.690009 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-294e0dc4-a800-4705-8fdb-00791ea4149b tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:00.690852 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-294e0dc4-a800-4705-8fdb-00791ea4149b tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:00.691548 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-294e0dc4-a800-4705-8fdb-00791ea4149b tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:00.763852 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-294e0dc4-a800-4705-8fdb-00791ea4149b tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:00.783401 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-294e0dc4-a800-4705-8fdb-00791ea4149b tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1266 microversion: 2.1 time: 0.100578 Jul 12 17:40:00.783401 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 50/111] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:00 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:00.783401 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-00cf4c00-f9ec-43b0-98e0-31e72869e2ad tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:00.783401 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-00cf4c00-f9ec-43b0-98e0-31e72869e2ad tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:00.787183 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-00cf4c00-f9ec-43b0-98e0-31e72869e2ad tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:00.787673 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-00cf4c00-f9ec-43b0-98e0-31e72869e2ad tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:00.788449 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-00cf4c00-f9ec-43b0-98e0-31e72869e2ad tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:00.789062 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-00cf4c00-f9ec-43b0-98e0-31e72869e2ad tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:00.843106 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-c7d6da22-e459-4d6b-ae22-fafb27b064b2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "POST /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64/action" status: 200 len: 32 microversion: 2.1 time: 0.592447 Jul 12 17:40:00.843885 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 62/112] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jul 12 17:40:00 2022] POST /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64/action => generated 32 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 17:40:00.858972 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-1a22821a-6c6f-417e-bd79-1a62ca611130 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:00.860101 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-1a22821a-6c6f-417e-bd79-1a62ca611130 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:00.866280 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1a22821a-6c6f-417e-bd79-1a62ca611130 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:00.866840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1a22821a-6c6f-417e-bd79-1a62ca611130 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:00.867786 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1a22821a-6c6f-417e-bd79-1a62ca611130 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:00.868248 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1a22821a-6c6f-417e-bd79-1a62ca611130 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:01.006837 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-00cf4c00-f9ec-43b0-98e0-31e72869e2ad tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:01.019482 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-00cf4c00-f9ec-43b0-98e0-31e72869e2ad tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:01.021035 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-00cf4c00-f9ec-43b0-98e0-31e72869e2ad tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:01.022204 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-00cf4c00-f9ec-43b0-98e0-31e72869e2ad tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1404 microversion: 2.20 time: 0.247554 Jul 12 17:40:01.022813 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 51/113] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:40:00 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1404 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:40:01.077847 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-1a22821a-6c6f-417e-bd79-1a62ca611130 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:01.086681 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-1a22821a-6c6f-417e-bd79-1a62ca611130 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.232608 Jul 12 17:40:01.087460 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 63/114] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:00 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:40:01.166115 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-01c5aece-3e37-446a-85fc-ad3295ef8270 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:01.167335 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-01c5aece-3e37-446a-85fc-ad3295ef8270 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:01.181887 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-01c5aece-3e37-446a-85fc-ad3295ef8270 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:01.182614 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-01c5aece-3e37-446a-85fc-ad3295ef8270 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:01.184232 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-01c5aece-3e37-446a-85fc-ad3295ef8270 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:01.185015 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-01c5aece-3e37-446a-85fc-ad3295ef8270 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:01.311485 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-6558fc37-ddf1-4342-983b-d46c34aa4885 req-4cb255da-29df-4ac3-b400-94efaf7a639b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f88418d-5f96-4c05-adf4-09d83f045699", "name": "network-vif-plugged", "status": "completed", "tag": "082490a4-d27d-40c5-93fa-92a28b71e068"}, {"server_uuid": "edf55e8a-cbc1-45b6-a138-21d5a07301d9", "name": "network-vif-plugged", "status": "completed", "tag": "e8c8b0fc-808c-4c82-a0f6-91314b49f8a9"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:40:01.338715 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-6558fc37-ddf1-4342-983b-d46c34aa4885 req-4cb255da-29df-4ac3-b400-94efaf7a639b service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:01.339826 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-6558fc37-ddf1-4342-983b-d46c34aa4885 req-4cb255da-29df-4ac3-b400-94efaf7a639b service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:01.355679 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-6558fc37-ddf1-4342-983b-d46c34aa4885 req-4cb255da-29df-4ac3-b400-94efaf7a639b service nova] Creating event network-vif-plugged:082490a4-d27d-40c5-93fa-92a28b71e068 for instance 7f88418d-5f96-4c05-adf4-09d83f045699 on hv-cinder-84875 Jul 12 17:40:01.357093 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-6558fc37-ddf1-4342-983b-d46c34aa4885 req-4cb255da-29df-4ac3-b400-94efaf7a639b service nova] Creating event network-vif-plugged:e8c8b0fc-808c-4c82-a0f6-91314b49f8a9 for instance edf55e8a-cbc1-45b6-a138-21d5a07301d9 on hv-cinder-84875 Jul 12 17:40:01.366005 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-6558fc37-ddf1-4342-983b-d46c34aa4885 req-4cb255da-29df-4ac3-b400-94efaf7a639b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.062762 Jul 12 17:40:01.368062 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 64/115] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:40:01.414178 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ee631e61-3762-4b59-86a2-9dea9a61bc36 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:01.415673 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-ee631e61-3762-4b59-86a2-9dea9a61bc36 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:01.425784 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ee631e61-3762-4b59-86a2-9dea9a61bc36 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:01.426712 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ee631e61-3762-4b59-86a2-9dea9a61bc36 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:01.427895 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ee631e61-3762-4b59-86a2-9dea9a61bc36 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:01.429200 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ee631e61-3762-4b59-86a2-9dea9a61bc36 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:01.437670 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:40:01.479122 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-01c5aece-3e37-446a-85fc-ad3295ef8270 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:01.488888 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-01c5aece-3e37-446a-85fc-ad3295ef8270 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 200 len: 1366 microversion: 2.1 time: 0.331223 Jul 12 17:40:01.489702 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 52/116] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:01 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:01.605680 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-ee631e61-3762-4b59-86a2-9dea9a61bc36 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:01.614459 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-ee631e61-3762-4b59-86a2-9dea9a61bc36 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1315 microversion: 2.1 time: 0.206314 Jul 12 17:40:01.615039 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 65/117] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:01 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:01.795612 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-7d76742e-f616-4029-9735-1c8b8c21040f tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:01.796215 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-7d76742e-f616-4029-9735-1c8b8c21040f tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:01.802483 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7d76742e-f616-4029-9735-1c8b8c21040f tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:01.805650 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7d76742e-f616-4029-9735-1c8b8c21040f tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:01.805650 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7d76742e-f616-4029-9735-1c8b8c21040f tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:01.805650 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7d76742e-f616-4029-9735-1c8b8c21040f tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:01.932376 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-7d76742e-f616-4029-9735-1c8b8c21040f tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:01.950313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-7d76742e-f616-4029-9735-1c8b8c21040f tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1274 microversion: 2.1 time: 0.158138 Jul 12 17:40:01.964874 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 53/118] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:01 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1274 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:02.052272 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-d0ced120-dccf-4bd2-aba9-7d0ba4b3a845 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:02.052830 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-d0ced120-dccf-4bd2-aba9-7d0ba4b3a845 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:02.061454 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d0ced120-dccf-4bd2-aba9-7d0ba4b3a845 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:02.062236 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d0ced120-dccf-4bd2-aba9-7d0ba4b3a845 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:02.063593 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d0ced120-dccf-4bd2-aba9-7d0ba4b3a845 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:02.064299 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d0ced120-dccf-4bd2-aba9-7d0ba4b3a845 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:02.110849 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-8a57f5ac-8713-4869-89db-8986c2b55f7b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:02.111591 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-8a57f5ac-8713-4869-89db-8986c2b55f7b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:02.131310 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8a57f5ac-8713-4869-89db-8986c2b55f7b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:02.136109 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8a57f5ac-8713-4869-89db-8986c2b55f7b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:02.142613 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8a57f5ac-8713-4869-89db-8986c2b55f7b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:02.143076 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8a57f5ac-8713-4869-89db-8986c2b55f7b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:02.589299 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-d0ced120-dccf-4bd2-aba9-7d0ba4b3a845 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:02.600913 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-d0ced120-dccf-4bd2-aba9-7d0ba4b3a845 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:02.602559 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-d0ced120-dccf-4bd2-aba9-7d0ba4b3a845 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:02.603745 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-d0ced120-dccf-4bd2-aba9-7d0ba4b3a845 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1404 microversion: 2.20 time: 0.555516 Jul 12 17:40:02.604333 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 66/119] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:40:02 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1404 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:40:02.619086 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-0b20e92a-ee69-47bd-8286-9c5d2b2e22fd tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:02.619793 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-0b20e92a-ee69-47bd-8286-9c5d2b2e22fd tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:02.636662 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0b20e92a-ee69-47bd-8286-9c5d2b2e22fd tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:02.638681 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0b20e92a-ee69-47bd-8286-9c5d2b2e22fd tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:02.640130 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0b20e92a-ee69-47bd-8286-9c5d2b2e22fd tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:02.640852 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0b20e92a-ee69-47bd-8286-9c5d2b2e22fd tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:02.672621 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-8a57f5ac-8713-4869-89db-8986c2b55f7b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:02.682012 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-8a57f5ac-8713-4869-89db-8986c2b55f7b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.579792 Jul 12 17:40:02.686822 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 54/120] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:02 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:02.697814 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-c420b260-eca7-45c2-a201-226a9b58ac77 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:02.698773 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-c420b260-eca7-45c2-a201-226a9b58ac77 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:02.713132 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c420b260-eca7-45c2-a201-226a9b58ac77 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:02.715172 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c420b260-eca7-45c2-a201-226a9b58ac77 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:02.723198 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c420b260-eca7-45c2-a201-226a9b58ac77 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:02.723950 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c420b260-eca7-45c2-a201-226a9b58ac77 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:03.141728 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-c420b260-eca7-45c2-a201-226a9b58ac77 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:03.150171 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-c420b260-eca7-45c2-a201-226a9b58ac77 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1502 microversion: 2.1 time: 0.462194 Jul 12 17:40:03.151084 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 55/121] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:02 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1502 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:03.156200 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-0ff42845-35c4-41f6-a7dd-ea1999ed68d1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:03.158069 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-0ff42845-35c4-41f6-a7dd-ea1999ed68d1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:03.165265 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ff42845-35c4-41f6-a7dd-ea1999ed68d1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:03.165899 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ff42845-35c4-41f6-a7dd-ea1999ed68d1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:03.166830 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ff42845-35c4-41f6-a7dd-ea1999ed68d1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:03.168181 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ff42845-35c4-41f6-a7dd-ea1999ed68d1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:03.327038 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-0b20e92a-ee69-47bd-8286-9c5d2b2e22fd tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:03.328352 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0ff42845-35c4-41f6-a7dd-ea1999ed68d1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:03.363526 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-0b20e92a-ee69-47bd-8286-9c5d2b2e22fd tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 200 len: 1366 microversion: 2.1 time: 0.756648 Jul 12 17:40:03.366043 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 67/122] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:02 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 1366 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:03.369699 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-0ff42845-35c4-41f6-a7dd-ea1999ed68d1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1272 microversion: 2.1 time: 0.215386 Jul 12 17:40:03.374272 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 56/123] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:03 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1272 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:03.627373 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-46dcd4d7-bb7e-435c-b6ed-c91aebdb6d56 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:03.628541 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-46dcd4d7-bb7e-435c-b6ed-c91aebdb6d56 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:03.642021 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-46dcd4d7-bb7e-435c-b6ed-c91aebdb6d56 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:03.643048 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-46dcd4d7-bb7e-435c-b6ed-c91aebdb6d56 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:03.644791 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-46dcd4d7-bb7e-435c-b6ed-c91aebdb6d56 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:03.645741 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-46dcd4d7-bb7e-435c-b6ed-c91aebdb6d56 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:03.707735 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-7aa04493-c647-4f4b-997d-daccdc9990fd tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:03.709367 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-7aa04493-c647-4f4b-997d-daccdc9990fd tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:03.722703 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7aa04493-c647-4f4b-997d-daccdc9990fd tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:03.723325 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7aa04493-c647-4f4b-997d-daccdc9990fd tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:03.724727 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7aa04493-c647-4f4b-997d-daccdc9990fd tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:03.725544 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7aa04493-c647-4f4b-997d-daccdc9990fd tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:03.861163 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-46dcd4d7-bb7e-435c-b6ed-c91aebdb6d56 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:03.896797 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-46dcd4d7-bb7e-435c-b6ed-c91aebdb6d56 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:03.899082 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-46dcd4d7-bb7e-435c-b6ed-c91aebdb6d56 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:03.900658 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-46dcd4d7-bb7e-435c-b6ed-c91aebdb6d56 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1404 microversion: 2.20 time: 0.282053 Jul 12 17:40:03.904123 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 68/124] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:40:03 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1404 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:40:04.183291 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-7aa04493-c647-4f4b-997d-daccdc9990fd tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:04.189765 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-7aa04493-c647-4f4b-997d-daccdc9990fd tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.491757 Jul 12 17:40:04.190350 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 57/125] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:03 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:40:04.385614 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-1d0dea31-f792-46a6-9238-03e5c6b3955d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:04.386221 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-1d0dea31-f792-46a6-9238-03e5c6b3955d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:04.395696 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-af94e4d6-bc2b-4af1-b49a-424f16d8d084 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:04.396514 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-af94e4d6-bc2b-4af1-b49a-424f16d8d084 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:04.397591 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1d0dea31-f792-46a6-9238-03e5c6b3955d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:04.403573 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1d0dea31-f792-46a6-9238-03e5c6b3955d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:04.403573 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1d0dea31-f792-46a6-9238-03e5c6b3955d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:04.403573 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1d0dea31-f792-46a6-9238-03e5c6b3955d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:04.404001 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-af94e4d6-bc2b-4af1-b49a-424f16d8d084 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:04.404545 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-af94e4d6-bc2b-4af1-b49a-424f16d8d084 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:04.405569 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-af94e4d6-bc2b-4af1-b49a-424f16d8d084 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:04.406077 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-af94e4d6-bc2b-4af1-b49a-424f16d8d084 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:04.658103 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-af94e4d6-bc2b-4af1-b49a-424f16d8d084 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:04.662140 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=100 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:40:04.672062 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-af94e4d6-bc2b-4af1-b49a-424f16d8d084 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1314 microversion: 2.1 time: 0.279083 Jul 12 17:40:04.685318 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 58/126] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:04 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:40:04.721841 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-1d0dea31-f792-46a6-9238-03e5c6b3955d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:04.755261 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-1d0dea31-f792-46a6-9238-03e5c6b3955d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 200 len: 1366 microversion: 2.1 time: 0.373155 Jul 12 17:40:04.760861 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 69/127] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:04 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 1366 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:04.931602 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-0ebec272-e35f-47b4-9234-3aedc3bb4fd9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:04.932287 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-0ebec272-e35f-47b4-9234-3aedc3bb4fd9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:04.944699 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ebec272-e35f-47b4-9234-3aedc3bb4fd9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:04.945507 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ebec272-e35f-47b4-9234-3aedc3bb4fd9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:04.947236 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ebec272-e35f-47b4-9234-3aedc3bb4fd9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:04.953693 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ebec272-e35f-47b4-9234-3aedc3bb4fd9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:05.223766 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-024e966a-c873-447f-b1d7-5adac7d8a10e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:05.224388 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-024e966a-c873-447f-b1d7-5adac7d8a10e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:05.253079 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0ebec272-e35f-47b4-9234-3aedc3bb4fd9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:05.255892 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-024e966a-c873-447f-b1d7-5adac7d8a10e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:05.260130 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-024e966a-c873-447f-b1d7-5adac7d8a10e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:05.266619 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-024e966a-c873-447f-b1d7-5adac7d8a10e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:05.266619 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-024e966a-c873-447f-b1d7-5adac7d8a10e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:05.288900 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0ebec272-e35f-47b4-9234-3aedc3bb4fd9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:05.301195 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0ebec272-e35f-47b4-9234-3aedc3bb4fd9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:05.302166 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-0ebec272-e35f-47b4-9234-3aedc3bb4fd9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1404 microversion: 2.20 time: 0.375478 Jul 12 17:40:05.313793 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 59/128] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:40:04 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1404 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:40:05.332847 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-951d0393-6983-4d0c-b4e0-c0ffa35faad6 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e8ff2ab-553c-4f30-aa61-ae20ad23de94"}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:40:05.334826 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-951d0393-6983-4d0c-b4e0-c0ffa35faad6 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:05.343581 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-951d0393-6983-4d0c-b4e0-c0ffa35faad6 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:05.344099 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-951d0393-6983-4d0c-b4e0-c0ffa35faad6 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:05.344949 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-951d0393-6983-4d0c-b4e0-c0ffa35faad6 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:05.345391 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-951d0393-6983-4d0c-b4e0-c0ffa35faad6 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:05.592119 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-024e966a-c873-447f-b1d7-5adac7d8a10e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:05.600168 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-024e966a-c873-447f-b1d7-5adac7d8a10e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.387088 Jul 12 17:40:05.603635 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 70/129] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:05 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:05.689829 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-e11c73fc-b15e-457f-940b-99727647edb6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:05.694535 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-e11c73fc-b15e-457f-940b-99727647edb6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:05.697070 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e11c73fc-b15e-457f-940b-99727647edb6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:05.697521 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e11c73fc-b15e-457f-940b-99727647edb6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:05.698284 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e11c73fc-b15e-457f-940b-99727647edb6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:05.698752 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e11c73fc-b15e-457f-940b-99727647edb6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:05.910869 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell0:SELECT=2 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:40:05.940089 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell0:SELECT=6 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:40:05.967835 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-e11c73fc-b15e-457f-940b-99727647edb6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:05.975569 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-e11c73fc-b15e-457f-940b-99727647edb6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1314 microversion: 2.1 time: 0.289775 Jul 12 17:40:05.976182 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 71/130] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:05 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:40:05.981146 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-49fa10d6-3a27-42ca-846f-22c023ce2245 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:05.981949 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-49fa10d6-3a27-42ca-846f-22c023ce2245 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:05.988638 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-49fa10d6-3a27-42ca-846f-22c023ce2245 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:05.989083 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-49fa10d6-3a27-42ca-846f-22c023ce2245 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:05.989956 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-49fa10d6-3a27-42ca-846f-22c023ce2245 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:05.990405 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-49fa10d6-3a27-42ca-846f-22c023ce2245 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:06.183642 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-49fa10d6-3a27-42ca-846f-22c023ce2245 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:06.192445 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-49fa10d6-3a27-42ca-846f-22c023ce2245 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 200 len: 1554 microversion: 2.1 time: 0.215080 Jul 12 17:40:06.193199 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 72/131] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:05 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 1554 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:06.198468 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-37c5363d-8869-467d-9e09-e9c89b9cca61 req-80919891-49f5-4a2b-b3c2-49404700f071 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9373a853-2fb9-427e-ba44-ec2825f27098", "tag": "77f4fa9f-c3dc-4191-a0cb-7038ffe804e4"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:40:06.207653 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-37c5363d-8869-467d-9e09-e9c89b9cca61 req-80919891-49f5-4a2b-b3c2-49404700f071 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:06.222874 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-37c5363d-8869-467d-9e09-e9c89b9cca61 req-80919891-49f5-4a2b-b3c2-49404700f071 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:06.222874 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-37c5363d-8869-467d-9e09-e9c89b9cca61 req-80919891-49f5-4a2b-b3c2-49404700f071 service nova] Creating event network-changed:77f4fa9f-c3dc-4191-a0cb-7038ffe804e4 for instance 9373a853-2fb9-427e-ba44-ec2825f27098 on hv-cinder-84875 Jul 12 17:40:06.239133 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-37c5363d-8869-467d-9e09-e9c89b9cca61 req-80919891-49f5-4a2b-b3c2-49404700f071 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044405 Jul 12 17:40:06.240154 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 73/132] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:40:06.245555 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-f1cd3184-8b35-43b6-ad87-c97231d4055e tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:06.246180 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-f1cd3184-8b35-43b6-ad87-c97231d4055e tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:06.253028 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f1cd3184-8b35-43b6-ad87-c97231d4055e tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:06.253459 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f1cd3184-8b35-43b6-ad87-c97231d4055e tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:06.254300 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f1cd3184-8b35-43b6-ad87-c97231d4055e tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:06.254768 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f1cd3184-8b35-43b6-ad87-c97231d4055e tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:06.357049 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-f1cd3184-8b35-43b6-ad87-c97231d4055e tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114832 Jul 12 17:40:06.357740 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 74/133] 10.222.0.16 () {58 vars in 1274 bytes} [Tue Jul 12 17:40:06 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:40:06.362862 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-870e2fba-8541-498a-8bdb-342a05f2b3f7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:06.363803 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-870e2fba-8541-498a-8bdb-342a05f2b3f7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:06.368092 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_api:SELECT=100 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:40:06.375024 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-870e2fba-8541-498a-8bdb-342a05f2b3f7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:06.375024 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-870e2fba-8541-498a-8bdb-342a05f2b3f7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:06.375547 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-870e2fba-8541-498a-8bdb-342a05f2b3f7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:06.376055 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-870e2fba-8541-498a-8bdb-342a05f2b3f7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:06.729433 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-870e2fba-8541-498a-8bdb-342a05f2b3f7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:06.740043 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-870e2fba-8541-498a-8bdb-342a05f2b3f7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:06.741612 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-870e2fba-8541-498a-8bdb-342a05f2b3f7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:06.742923 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-870e2fba-8541-498a-8bdb-342a05f2b3f7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1596 microversion: 2.20 time: 0.384030 Jul 12 17:40:06.743552 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 75/134] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:40:06 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1596 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:40:06.755181 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a50f79e0-182c-410d-8a69-3580f52ce2d9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:06.768643 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-a50f79e0-182c-410d-8a69-3580f52ce2d9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:06.779765 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a50f79e0-182c-410d-8a69-3580f52ce2d9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:06.780736 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a50f79e0-182c-410d-8a69-3580f52ce2d9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:06.782200 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a50f79e0-182c-410d-8a69-3580f52ce2d9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:06.782850 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a50f79e0-182c-410d-8a69-3580f52ce2d9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:07.110355 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a50f79e0-182c-410d-8a69-3580f52ce2d9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:07.123007 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-a50f79e0-182c-410d-8a69-3580f52ce2d9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.377942 Jul 12 17:40:07.124063 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 76/135] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:06 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:07.132779 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-6393b653-df6a-47d5-bef5-af2d52d4ed80 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:07.133757 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-6393b653-df6a-47d5-bef5-af2d52d4ed80 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:07.143093 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6393b653-df6a-47d5-bef5-af2d52d4ed80 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:07.144046 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6393b653-df6a-47d5-bef5-af2d52d4ed80 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:07.145161 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6393b653-df6a-47d5-bef5-af2d52d4ed80 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:07.146005 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6393b653-df6a-47d5-bef5-af2d52d4ed80 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:07.355280 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-6393b653-df6a-47d5-bef5-af2d52d4ed80 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.229671 Jul 12 17:40:07.356133 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 77/136] 10.222.0.16 () {60 vars in 1315 bytes} [Tue Jul 12 17:40:07 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699/os-interface => generated 285 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:40:07.361402 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ce241694-b40f-4feb-86ec-6ec55b9eb946 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:07.362539 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-ce241694-b40f-4feb-86ec-6ec55b9eb946 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:07.373017 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ce241694-b40f-4feb-86ec-6ec55b9eb946 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:07.373017 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ce241694-b40f-4feb-86ec-6ec55b9eb946 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:07.373017 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ce241694-b40f-4feb-86ec-6ec55b9eb946 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:07.373507 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ce241694-b40f-4feb-86ec-6ec55b9eb946 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:07.378994 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell0:SELECT=4 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:40:07.581198 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-951d0393-6983-4d0c-b4e0-c0ffa35faad6 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "POST /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.255720 Jul 12 17:40:07.583457 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 60/137] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jul 12 17:40:05 2022] POST /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d/os-volume_attachments => generated 194 bytes in 2260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:40:07.817428 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-ce241694-b40f-4feb-86ec-6ec55b9eb946 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:07.832701 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-ce241694-b40f-4feb-86ec-6ec55b9eb946 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1314 microversion: 2.1 time: 0.474428 Jul 12 17:40:07.834296 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 78/138] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:07 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:08.147817 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-bbd9b085-209e-4793-8bcd-4893d7ea8cc5 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:08.149108 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-bbd9b085-209e-4793-8bcd-4893d7ea8cc5 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:08.164993 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bbd9b085-209e-4793-8bcd-4893d7ea8cc5 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:08.165761 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bbd9b085-209e-4793-8bcd-4893d7ea8cc5 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:08.167145 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bbd9b085-209e-4793-8bcd-4893d7ea8cc5 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:08.167886 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bbd9b085-209e-4793-8bcd-4893d7ea8cc5 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:08.445319 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-88d0f396-9b76-4a8a-9b7d-ccb9b87fc126 req-ecd03323-ce4d-4f5e-889c-8851db0d7062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edf55e8a-cbc1-45b6-a138-21d5a07301d9", "tag": "e8c8b0fc-808c-4c82-a0f6-91314b49f8a9"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:40:08.457135 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-88d0f396-9b76-4a8a-9b7d-ccb9b87fc126 req-ecd03323-ce4d-4f5e-889c-8851db0d7062 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:08.458957 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-88d0f396-9b76-4a8a-9b7d-ccb9b87fc126 req-ecd03323-ce4d-4f5e-889c-8851db0d7062 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:08.477370 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-88d0f396-9b76-4a8a-9b7d-ccb9b87fc126 req-ecd03323-ce4d-4f5e-889c-8851db0d7062 service nova] Creating event network-changed:e8c8b0fc-808c-4c82-a0f6-91314b49f8a9 for instance edf55e8a-cbc1-45b6-a138-21d5a07301d9 on hv-cinder-84875 Jul 12 17:40:08.489148 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-88d0f396-9b76-4a8a-9b7d-ccb9b87fc126 req-ecd03323-ce4d-4f5e-889c-8851db0d7062 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049183 Jul 12 17:40:08.490458 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 79/139] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:40:08.636565 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-bbd9b085-209e-4793-8bcd-4893d7ea8cc5 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:08.645674 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-bbd9b085-209e-4793-8bcd-4893d7ea8cc5 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.507922 Jul 12 17:40:08.646657 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 61/140] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:08 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:08.860661 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-89c34f3b-b9e6-4032-af1c-c8898f840604 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:08.862001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-89c34f3b-b9e6-4032-af1c-c8898f840604 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:08.874849 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-89c34f3b-b9e6-4032-af1c-c8898f840604 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:08.875704 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-89c34f3b-b9e6-4032-af1c-c8898f840604 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:08.877346 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-89c34f3b-b9e6-4032-af1c-c8898f840604 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:08.878144 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-89c34f3b-b9e6-4032-af1c-c8898f840604 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:09.078060 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-89c34f3b-b9e6-4032-af1c-c8898f840604 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:09.090565 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-89c34f3b-b9e6-4032-af1c-c8898f840604 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1314 microversion: 2.1 time: 0.238608 Jul 12 17:40:09.102043 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 80/141] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:08 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:09.666673 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-02767638-41d5-41b7-8781-330265b57a5f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:09.667359 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-02767638-41d5-41b7-8781-330265b57a5f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:09.684221 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-02767638-41d5-41b7-8781-330265b57a5f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:09.684712 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-02767638-41d5-41b7-8781-330265b57a5f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:09.692285 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-02767638-41d5-41b7-8781-330265b57a5f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:09.692936 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-02767638-41d5-41b7-8781-330265b57a5f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:09.953132 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-40f043bc-9f63-4214-a5f5-f7113333ea41 req-10576ec5-49c8-4805-ab84-8cee0cdd89d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f88418d-5f96-4c05-adf4-09d83f045699", "tag": "082490a4-d27d-40c5-93fa-92a28b71e068"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:40:09.963345 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-40f043bc-9f63-4214-a5f5-f7113333ea41 req-10576ec5-49c8-4805-ab84-8cee0cdd89d4 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:09.964051 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-40f043bc-9f63-4214-a5f5-f7113333ea41 req-10576ec5-49c8-4805-ab84-8cee0cdd89d4 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:09.979129 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-40f043bc-9f63-4214-a5f5-f7113333ea41 req-10576ec5-49c8-4805-ab84-8cee0cdd89d4 service nova] Creating event network-changed:082490a4-d27d-40c5-93fa-92a28b71e068 for instance 7f88418d-5f96-4c05-adf4-09d83f045699 on hv-cinder-84875 Jul 12 17:40:09.985540 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-40f043bc-9f63-4214-a5f5-f7113333ea41 req-10576ec5-49c8-4805-ab84-8cee0cdd89d4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036746 Jul 12 17:40:09.986799 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 81/142] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:40:10.114317 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-f1df14f1-b36c-4316-b3e3-85e359acaa49 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:10.115131 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-f1df14f1-b36c-4316-b3e3-85e359acaa49 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:10.132773 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f1df14f1-b36c-4316-b3e3-85e359acaa49 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:10.133496 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f1df14f1-b36c-4316-b3e3-85e359acaa49 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:10.134355 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f1df14f1-b36c-4316-b3e3-85e359acaa49 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:10.134826 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f1df14f1-b36c-4316-b3e3-85e359acaa49 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:10.147528 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-02767638-41d5-41b7-8781-330265b57a5f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:10.169773 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-02767638-41d5-41b7-8781-330265b57a5f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.509978 Jul 12 17:40:10.170530 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 62/143] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:09 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:10.368956 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-f1df14f1-b36c-4316-b3e3-85e359acaa49 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:10.380368 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-f1df14f1-b36c-4316-b3e3-85e359acaa49 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1314 microversion: 2.1 time: 0.271025 Jul 12 17:40:10.381508 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 82/144] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:10 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:11.190541 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-333b56ed-7049-4c15-ac27-b9d12a47827f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:11.191364 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-333b56ed-7049-4c15-ac27-b9d12a47827f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:11.198910 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-333b56ed-7049-4c15-ac27-b9d12a47827f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:11.199938 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-333b56ed-7049-4c15-ac27-b9d12a47827f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:11.200816 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-333b56ed-7049-4c15-ac27-b9d12a47827f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:11.201255 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-333b56ed-7049-4c15-ac27-b9d12a47827f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:11.343050 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-333b56ed-7049-4c15-ac27-b9d12a47827f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:11.351380 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-333b56ed-7049-4c15-ac27-b9d12a47827f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.165164 Jul 12 17:40:11.351966 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 63/145] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:11 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:40:11.405946 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-43911bce-c1e3-428c-927d-9a5c5bd03c82 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:11.406629 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-43911bce-c1e3-428c-927d-9a5c5bd03c82 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:11.413116 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-43911bce-c1e3-428c-927d-9a5c5bd03c82 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:11.413677 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-43911bce-c1e3-428c-927d-9a5c5bd03c82 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:11.414475 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-43911bce-c1e3-428c-927d-9a5c5bd03c82 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:11.414919 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-43911bce-c1e3-428c-927d-9a5c5bd03c82 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:11.561035 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-43911bce-c1e3-428c-927d-9a5c5bd03c82 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:11.569104 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-43911bce-c1e3-428c-927d-9a5c5bd03c82 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1314 microversion: 2.1 time: 0.167066 Jul 12 17:40:11.569684 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 83/146] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:11 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:12.369112 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-c9351063-d04f-4294-ba80-338a36b1cb3b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:12.369755 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-c9351063-d04f-4294-ba80-338a36b1cb3b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:12.377162 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c9351063-d04f-4294-ba80-338a36b1cb3b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:12.377619 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c9351063-d04f-4294-ba80-338a36b1cb3b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:12.378394 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c9351063-d04f-4294-ba80-338a36b1cb3b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:12.378886 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c9351063-d04f-4294-ba80-338a36b1cb3b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:12.515046 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-c9351063-d04f-4294-ba80-338a36b1cb3b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:12.522729 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-c9351063-d04f-4294-ba80-338a36b1cb3b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.157581 Jul 12 17:40:12.523298 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 64/147] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:12 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:12.585627 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-68d60be9-98fa-433b-8ebb-125401b1ae38 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:12.586229 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-68d60be9-98fa-433b-8ebb-125401b1ae38 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:12.592493 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-68d60be9-98fa-433b-8ebb-125401b1ae38 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:12.592950 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-68d60be9-98fa-433b-8ebb-125401b1ae38 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:12.593785 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-68d60be9-98fa-433b-8ebb-125401b1ae38 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:12.594568 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-68d60be9-98fa-433b-8ebb-125401b1ae38 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:12.614983 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=100 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:40:12.733263 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-68d60be9-98fa-433b-8ebb-125401b1ae38 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:12.740905 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-68d60be9-98fa-433b-8ebb-125401b1ae38 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1314 microversion: 2.1 time: 0.159030 Jul 12 17:40:12.741487 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 84/148] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:12 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:13.539455 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-6f5949ea-e84c-4c3a-928f-c5d594b8889d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:13.540064 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-6f5949ea-e84c-4c3a-928f-c5d594b8889d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:13.546782 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6f5949ea-e84c-4c3a-928f-c5d594b8889d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:13.547235 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6f5949ea-e84c-4c3a-928f-c5d594b8889d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:13.548006 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6f5949ea-e84c-4c3a-928f-c5d594b8889d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:13.548444 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6f5949ea-e84c-4c3a-928f-c5d594b8889d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:13.696138 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-6f5949ea-e84c-4c3a-928f-c5d594b8889d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:13.703364 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-6f5949ea-e84c-4c3a-928f-c5d594b8889d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.167783 Jul 12 17:40:13.703938 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 65/149] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:13 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:40:13.761485 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-d3add539-1ea4-4c59-9c41-20ce032d3042 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:13.763094 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-d3add539-1ea4-4c59-9c41-20ce032d3042 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:13.769897 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d3add539-1ea4-4c59-9c41-20ce032d3042 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:13.770347 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d3add539-1ea4-4c59-9c41-20ce032d3042 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:13.771189 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d3add539-1ea4-4c59-9c41-20ce032d3042 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:13.771630 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d3add539-1ea4-4c59-9c41-20ce032d3042 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:13.912846 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-d3add539-1ea4-4c59-9c41-20ce032d3042 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:13.921430 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-d3add539-1ea4-4c59-9c41-20ce032d3042 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1314 microversion: 2.1 time: 0.163896 Jul 12 17:40:13.922018 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 85/150] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:13 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:40:14.320916 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-d83a2b3e-c905-4163-8252-5d8612ada7b0 req-2a6df3d1-bfc0-4f77-b968-c303f2ddf597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9373a853-2fb9-427e-ba44-ec2825f27098", "name": "network-vif-plugged", "status": "completed", "tag": "77f4fa9f-c3dc-4191-a0cb-7038ffe804e4"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:40:14.326794 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:40:14.331136 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-d83a2b3e-c905-4163-8252-5d8612ada7b0 req-2a6df3d1-bfc0-4f77-b968-c303f2ddf597 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:14.331578 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-d83a2b3e-c905-4163-8252-5d8612ada7b0 req-2a6df3d1-bfc0-4f77-b968-c303f2ddf597 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:14.343436 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-d83a2b3e-c905-4163-8252-5d8612ada7b0 req-2a6df3d1-bfc0-4f77-b968-c303f2ddf597 service nova] Creating event network-vif-plugged:77f4fa9f-c3dc-4191-a0cb-7038ffe804e4 for instance 9373a853-2fb9-427e-ba44-ec2825f27098 on hv-cinder-84875 Jul 12 17:40:14.348366 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-d83a2b3e-c905-4163-8252-5d8612ada7b0 req-2a6df3d1-bfc0-4f77-b968-c303f2ddf597 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031661 Jul 12 17:40:14.349235 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 66/151] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:40:14.729369 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-d9baf1c4-d0e8-4b59-bda8-023e3f4f51f4 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:14.729369 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-d9baf1c4-d0e8-4b59-bda8-023e3f4f51f4 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:14.730762 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d9baf1c4-d0e8-4b59-bda8-023e3f4f51f4 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:14.731430 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d9baf1c4-d0e8-4b59-bda8-023e3f4f51f4 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:14.732787 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d9baf1c4-d0e8-4b59-bda8-023e3f4f51f4 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:14.733265 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d9baf1c4-d0e8-4b59-bda8-023e3f4f51f4 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:14.890611 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-d9baf1c4-d0e8-4b59-bda8-023e3f4f51f4 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:14.906335 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-d9baf1c4-d0e8-4b59-bda8-023e3f4f51f4 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.188976 Jul 12 17:40:14.906975 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 86/152] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:14 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:14.938832 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-6bfe3b0e-8e29-4a11-9462-7f7fc013f9e6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:14.939431 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-6bfe3b0e-8e29-4a11-9462-7f7fc013f9e6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:14.946715 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6bfe3b0e-8e29-4a11-9462-7f7fc013f9e6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:14.947154 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6bfe3b0e-8e29-4a11-9462-7f7fc013f9e6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:14.947922 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6bfe3b0e-8e29-4a11-9462-7f7fc013f9e6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:14.948362 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6bfe3b0e-8e29-4a11-9462-7f7fc013f9e6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:15.087243 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-6bfe3b0e-8e29-4a11-9462-7f7fc013f9e6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:15.095901 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-6bfe3b0e-8e29-4a11-9462-7f7fc013f9e6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1314 microversion: 2.1 time: 0.162035 Jul 12 17:40:15.096489 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 67/153] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:14 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:15.924164 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-565aae49-e752-461f-9b90-a59d3b73d00c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:15.924763 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-565aae49-e752-461f-9b90-a59d3b73d00c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:15.930941 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-565aae49-e752-461f-9b90-a59d3b73d00c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:15.931386 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-565aae49-e752-461f-9b90-a59d3b73d00c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:15.932144 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-565aae49-e752-461f-9b90-a59d3b73d00c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:15.932569 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-565aae49-e752-461f-9b90-a59d3b73d00c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:16.063024 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-565aae49-e752-461f-9b90-a59d3b73d00c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:16.070903 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-565aae49-e752-461f-9b90-a59d3b73d00c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.151268 Jul 12 17:40:16.071417 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 87/154] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:15 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:16.116084 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-ff1dcd78-ddda-4017-84e9-ef931755dc8d tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:16.116728 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-ff1dcd78-ddda-4017-84e9-ef931755dc8d tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:16.123627 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ff1dcd78-ddda-4017-84e9-ef931755dc8d tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:16.124082 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ff1dcd78-ddda-4017-84e9-ef931755dc8d tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:16.124864 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ff1dcd78-ddda-4017-84e9-ef931755dc8d tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:16.125300 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ff1dcd78-ddda-4017-84e9-ef931755dc8d tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:16.261742 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ff1dcd78-ddda-4017-84e9-ef931755dc8d tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:16.270990 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-ff1dcd78-ddda-4017-84e9-ef931755dc8d tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1314 microversion: 2.1 time: 0.160882 Jul 12 17:40:16.271162 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 68/155] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:16 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:17.088316 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-59c0bcf7-b0ab-4ba7-a641-89219884b686 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:17.088845 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-59c0bcf7-b0ab-4ba7-a641-89219884b686 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:17.095299 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-59c0bcf7-b0ab-4ba7-a641-89219884b686 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:17.095760 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-59c0bcf7-b0ab-4ba7-a641-89219884b686 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:17.096562 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-59c0bcf7-b0ab-4ba7-a641-89219884b686 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:17.096993 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-59c0bcf7-b0ab-4ba7-a641-89219884b686 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:17.253213 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-59c0bcf7-b0ab-4ba7-a641-89219884b686 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:17.262710 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-59c0bcf7-b0ab-4ba7-a641-89219884b686 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.178211 Jul 12 17:40:17.263353 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 88/156] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:17 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:40:17.287682 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-d2d2ceff-4585-4031-9cb6-e7f27b0d3466 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:17.288498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-d2d2ceff-4585-4031-9cb6-e7f27b0d3466 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:17.295971 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d2d2ceff-4585-4031-9cb6-e7f27b0d3466 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:17.296421 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d2d2ceff-4585-4031-9cb6-e7f27b0d3466 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:17.300460 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d2d2ceff-4585-4031-9cb6-e7f27b0d3466 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:17.300460 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d2d2ceff-4585-4031-9cb6-e7f27b0d3466 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:17.433485 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-d2d2ceff-4585-4031-9cb6-e7f27b0d3466 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:17.441457 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-d2d2ceff-4585-4031-9cb6-e7f27b0d3466 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1314 microversion: 2.1 time: 0.157614 Jul 12 17:40:17.442145 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 69/157] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:17 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:18.288143 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-cc5b07f3-c2ae-4abe-a9e3-87ac0bc7ef01 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:18.289210 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-cc5b07f3-c2ae-4abe-a9e3-87ac0bc7ef01 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:18.299917 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cc5b07f3-c2ae-4abe-a9e3-87ac0bc7ef01 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:18.300651 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cc5b07f3-c2ae-4abe-a9e3-87ac0bc7ef01 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:18.302348 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cc5b07f3-c2ae-4abe-a9e3-87ac0bc7ef01 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:18.302836 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cc5b07f3-c2ae-4abe-a9e3-87ac0bc7ef01 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:18.451597 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-cc5b07f3-c2ae-4abe-a9e3-87ac0bc7ef01 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:18.458712 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-4d073390-d4c7-49e0-9817-cf644aff371e tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:18.459556 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-4d073390-d4c7-49e0-9817-cf644aff371e tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:18.461139 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-cc5b07f3-c2ae-4abe-a9e3-87ac0bc7ef01 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.179658 Jul 12 17:40:18.461733 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 89/158] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:18 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:18.466751 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4d073390-d4c7-49e0-9817-cf644aff371e tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:18.467182 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4d073390-d4c7-49e0-9817-cf644aff371e tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:18.467983 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4d073390-d4c7-49e0-9817-cf644aff371e tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:18.468427 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4d073390-d4c7-49e0-9817-cf644aff371e tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:18.629022 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-4d073390-d4c7-49e0-9817-cf644aff371e tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:18.638130 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-4d073390-d4c7-49e0-9817-cf644aff371e tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1314 microversion: 2.1 time: 0.183429 Jul 12 17:40:18.638853 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 70/159] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:18 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:40:19.485723 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-d908880a-6e31-4664-9ff5-b2512e788e0a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:19.486332 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-d908880a-6e31-4664-9ff5-b2512e788e0a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:19.493023 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d908880a-6e31-4664-9ff5-b2512e788e0a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:19.493600 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d908880a-6e31-4664-9ff5-b2512e788e0a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:19.494277 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d908880a-6e31-4664-9ff5-b2512e788e0a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:19.494742 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d908880a-6e31-4664-9ff5-b2512e788e0a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:19.629862 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-d908880a-6e31-4664-9ff5-b2512e788e0a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:19.637434 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-d908880a-6e31-4664-9ff5-b2512e788e0a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.156226 Jul 12 17:40:19.638002 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 90/160] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:19 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:19.656318 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-e3e8cc19-8160-4459-86ed-bb4d9a03a234 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:19.656919 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-e3e8cc19-8160-4459-86ed-bb4d9a03a234 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:19.663402 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e3e8cc19-8160-4459-86ed-bb4d9a03a234 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:19.663855 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e3e8cc19-8160-4459-86ed-bb4d9a03a234 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:19.664616 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e3e8cc19-8160-4459-86ed-bb4d9a03a234 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:19.665044 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e3e8cc19-8160-4459-86ed-bb4d9a03a234 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:19.797522 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-e3e8cc19-8160-4459-86ed-bb4d9a03a234 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:19.805308 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-e3e8cc19-8160-4459-86ed-bb4d9a03a234 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1314 microversion: 2.1 time: 0.153367 Jul 12 17:40:19.805885 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 71/161] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:19 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:20.654285 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-68dbdf00-1e0d-4631-82de-cdeb2b2ce5d2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:20.655008 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-68dbdf00-1e0d-4631-82de-cdeb2b2ce5d2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:20.661349 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-68dbdf00-1e0d-4631-82de-cdeb2b2ce5d2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:20.661785 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-68dbdf00-1e0d-4631-82de-cdeb2b2ce5d2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:20.662583 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-68dbdf00-1e0d-4631-82de-cdeb2b2ce5d2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:20.663172 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-68dbdf00-1e0d-4631-82de-cdeb2b2ce5d2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:20.799454 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-68dbdf00-1e0d-4631-82de-cdeb2b2ce5d2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:20.808525 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-68dbdf00-1e0d-4631-82de-cdeb2b2ce5d2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.158080 Jul 12 17:40:20.809103 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 91/162] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:20 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:20.822718 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-7446d5e1-a6c5-41de-9565-7c8c891a16c2 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:20.823325 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-7446d5e1-a6c5-41de-9565-7c8c891a16c2 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:20.830795 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7446d5e1-a6c5-41de-9565-7c8c891a16c2 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:20.831242 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7446d5e1-a6c5-41de-9565-7c8c891a16c2 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:20.832270 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7446d5e1-a6c5-41de-9565-7c8c891a16c2 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:20.832733 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7446d5e1-a6c5-41de-9565-7c8c891a16c2 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:20.975668 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-7446d5e1-a6c5-41de-9565-7c8c891a16c2 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:20.983127 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-7446d5e1-a6c5-41de-9565-7c8c891a16c2 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1314 microversion: 2.1 time: 0.164524 Jul 12 17:40:20.983891 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 72/163] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:20 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:21.827000 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a72a6d5e-fe7b-4b7e-b159-0d0379768051 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:21.827609 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-a72a6d5e-fe7b-4b7e-b159-0d0379768051 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:21.833881 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a72a6d5e-fe7b-4b7e-b159-0d0379768051 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:21.834277 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a72a6d5e-fe7b-4b7e-b159-0d0379768051 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:21.835076 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a72a6d5e-fe7b-4b7e-b159-0d0379768051 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:21.835518 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a72a6d5e-fe7b-4b7e-b159-0d0379768051 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:21.975933 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a72a6d5e-fe7b-4b7e-b159-0d0379768051 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:21.983592 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-a72a6d5e-fe7b-4b7e-b159-0d0379768051 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.160927 Jul 12 17:40:21.984199 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 92/164] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:21 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:22.000281 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-6b76c4f2-73fd-4c01-9063-7648a3cdf68d tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:22.000919 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-6b76c4f2-73fd-4c01-9063-7648a3cdf68d tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:22.008150 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6b76c4f2-73fd-4c01-9063-7648a3cdf68d tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:22.008591 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6b76c4f2-73fd-4c01-9063-7648a3cdf68d tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:22.009484 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6b76c4f2-73fd-4c01-9063-7648a3cdf68d tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:22.009937 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6b76c4f2-73fd-4c01-9063-7648a3cdf68d tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:22.143802 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-6b76c4f2-73fd-4c01-9063-7648a3cdf68d tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:22.151719 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-6b76c4f2-73fd-4c01-9063-7648a3cdf68d tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1314 microversion: 2.1 time: 0.155518 Jul 12 17:40:22.152293 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 73/165] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:21 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:23.002501 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-67f27b30-e89b-4d9d-bbda-3dc83b0df4b7 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:23.003111 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-67f27b30-e89b-4d9d-bbda-3dc83b0df4b7 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:23.009549 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-67f27b30-e89b-4d9d-bbda-3dc83b0df4b7 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:23.009916 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-67f27b30-e89b-4d9d-bbda-3dc83b0df4b7 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:23.010721 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-67f27b30-e89b-4d9d-bbda-3dc83b0df4b7 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:23.011158 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-67f27b30-e89b-4d9d-bbda-3dc83b0df4b7 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:23.159351 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-67f27b30-e89b-4d9d-bbda-3dc83b0df4b7 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:23.169067 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-67f27b30-e89b-4d9d-bbda-3dc83b0df4b7 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.171737 Jul 12 17:40:23.169305 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-cb11d9ec-8ff0-4706-8aac-1b2af5cdffda tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:23.169877 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-cb11d9ec-8ff0-4706-8aac-1b2af5cdffda tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:23.177524 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cb11d9ec-8ff0-4706-8aac-1b2af5cdffda tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:23.178273 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cb11d9ec-8ff0-4706-8aac-1b2af5cdffda tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:23.180446 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cb11d9ec-8ff0-4706-8aac-1b2af5cdffda tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:23.180572 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 93/166] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:22 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:23.180676 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cb11d9ec-8ff0-4706-8aac-1b2af5cdffda tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:23.334750 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-cb11d9ec-8ff0-4706-8aac-1b2af5cdffda tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:23.337434 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:40:23.343565 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-cb11d9ec-8ff0-4706-8aac-1b2af5cdffda tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1314 microversion: 2.1 time: 0.178219 Jul 12 17:40:23.344367 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 74/167] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:23 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:40:24.186208 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-9de2177f-572e-43cd-a2a2-91ae1c887548 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:24.187048 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-9de2177f-572e-43cd-a2a2-91ae1c887548 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:24.193478 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9de2177f-572e-43cd-a2a2-91ae1c887548 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:24.193932 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9de2177f-572e-43cd-a2a2-91ae1c887548 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:24.194742 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9de2177f-572e-43cd-a2a2-91ae1c887548 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:24.195181 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9de2177f-572e-43cd-a2a2-91ae1c887548 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:24.333386 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-9de2177f-572e-43cd-a2a2-91ae1c887548 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:24.341671 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-9de2177f-572e-43cd-a2a2-91ae1c887548 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.159259 Jul 12 17:40:24.342282 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 94/168] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:24 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:24.361727 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-a612c513-db6e-4b4b-9945-59f593a8903e tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:24.362351 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-a612c513-db6e-4b4b-9945-59f593a8903e tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:24.370145 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a612c513-db6e-4b4b-9945-59f593a8903e tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:24.370634 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a612c513-db6e-4b4b-9945-59f593a8903e tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:24.371487 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a612c513-db6e-4b4b-9945-59f593a8903e tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:24.371928 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a612c513-db6e-4b4b-9945-59f593a8903e tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:24.541298 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-a612c513-db6e-4b4b-9945-59f593a8903e tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:24.550407 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-a612c513-db6e-4b4b-9945-59f593a8903e tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1314 microversion: 2.1 time: 0.193214 Jul 12 17:40:24.551028 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 75/169] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:24 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:40:25.361052 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-f2c07bd5-c0c3-4fb2-bf81-84a094f94f88 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:25.361640 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-f2c07bd5-c0c3-4fb2-bf81-84a094f94f88 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:25.367692 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f2c07bd5-c0c3-4fb2-bf81-84a094f94f88 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:25.368141 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f2c07bd5-c0c3-4fb2-bf81-84a094f94f88 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:25.368898 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f2c07bd5-c0c3-4fb2-bf81-84a094f94f88 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:25.369325 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f2c07bd5-c0c3-4fb2-bf81-84a094f94f88 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:25.500695 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-f2c07bd5-c0c3-4fb2-bf81-84a094f94f88 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:25.508176 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-f2c07bd5-c0c3-4fb2-bf81-84a094f94f88 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.151898 Jul 12 17:40:25.508739 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 95/170] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:25 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:25.568135 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-c37b9a91-2ed3-46c4-a32d-ed956e755fc1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:25.568838 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-c37b9a91-2ed3-46c4-a32d-ed956e755fc1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:25.575980 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c37b9a91-2ed3-46c4-a32d-ed956e755fc1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:25.577590 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c37b9a91-2ed3-46c4-a32d-ed956e755fc1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:25.577590 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c37b9a91-2ed3-46c4-a32d-ed956e755fc1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:25.577762 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c37b9a91-2ed3-46c4-a32d-ed956e755fc1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:25.715613 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-c37b9a91-2ed3-46c4-a32d-ed956e755fc1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:25.724035 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-c37b9a91-2ed3-46c4-a32d-ed956e755fc1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1314 microversion: 2.1 time: 0.160546 Jul 12 17:40:25.724600 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 76/171] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:25 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:26.525051 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ed429239-51f7-4953-8be7-440c981cd09b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:26.525660 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-ed429239-51f7-4953-8be7-440c981cd09b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:26.531875 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ed429239-51f7-4953-8be7-440c981cd09b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:26.532325 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ed429239-51f7-4953-8be7-440c981cd09b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:26.533100 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ed429239-51f7-4953-8be7-440c981cd09b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:26.533540 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ed429239-51f7-4953-8be7-440c981cd09b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:26.671665 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-ed429239-51f7-4953-8be7-440c981cd09b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:26.679409 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-ed429239-51f7-4953-8be7-440c981cd09b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.158282 Jul 12 17:40:26.679991 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 96/172] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:26 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:26.741628 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-0ae7ebfc-4182-400c-9ff8-858ae9792994 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:26.742270 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-0ae7ebfc-4182-400c-9ff8-858ae9792994 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:26.749957 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ae7ebfc-4182-400c-9ff8-858ae9792994 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:26.750403 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ae7ebfc-4182-400c-9ff8-858ae9792994 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:26.751194 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ae7ebfc-4182-400c-9ff8-858ae9792994 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:26.751624 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ae7ebfc-4182-400c-9ff8-858ae9792994 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:26.900212 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0ae7ebfc-4182-400c-9ff8-858ae9792994 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:26.913950 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-0ae7ebfc-4182-400c-9ff8-858ae9792994 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1314 microversion: 2.1 time: 0.176039 Jul 12 17:40:26.915037 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 77/173] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:26 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:27.701815 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ebf73b12-f042-4096-a36d-ca0151964187 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:27.703003 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-ebf73b12-f042-4096-a36d-ca0151964187 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:27.718848 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ebf73b12-f042-4096-a36d-ca0151964187 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:27.719659 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ebf73b12-f042-4096-a36d-ca0151964187 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:27.721055 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ebf73b12-f042-4096-a36d-ca0151964187 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:27.721840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ebf73b12-f042-4096-a36d-ca0151964187 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:27.898027 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-ebf73b12-f042-4096-a36d-ca0151964187 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:27.907140 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-ebf73b12-f042-4096-a36d-ca0151964187 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.212682 Jul 12 17:40:27.908068 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 97/174] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:27 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:27.961030 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-04d6c9c6-96ad-42c0-b3d7-7b9a7df49fca tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:27.961030 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-04d6c9c6-96ad-42c0-b3d7-7b9a7df49fca tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:27.961030 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-04d6c9c6-96ad-42c0-b3d7-7b9a7df49fca tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:27.961030 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-04d6c9c6-96ad-42c0-b3d7-7b9a7df49fca tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:27.962045 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-04d6c9c6-96ad-42c0-b3d7-7b9a7df49fca tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:27.962937 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-04d6c9c6-96ad-42c0-b3d7-7b9a7df49fca tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:28.132328 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-04d6c9c6-96ad-42c0-b3d7-7b9a7df49fca tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:28.140856 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-04d6c9c6-96ad-42c0-b3d7-7b9a7df49fca tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1314 microversion: 2.1 time: 0.204682 Jul 12 17:40:28.141912 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 78/175] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:27 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:28.580676 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-74ce0842-1e51-44fe-aab9-691790ab092d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:28.581178 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-74ce0842-1e51-44fe-aab9-691790ab092d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:28.588945 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-74ce0842-1e51-44fe-aab9-691790ab092d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:28.588945 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-74ce0842-1e51-44fe-aab9-691790ab092d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:28.590219 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-74ce0842-1e51-44fe-aab9-691790ab092d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:28.590219 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-74ce0842-1e51-44fe-aab9-691790ab092d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:28.620053 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-74ce0842-1e51-44fe-aab9-691790ab092d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Going to try to terminate instance {{(pid=130059) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:40:28.927257 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-3cdcabb9-ce5f-4aa1-91d9-646c82224155 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:28.927808 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-3cdcabb9-ce5f-4aa1-91d9-646c82224155 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:28.934834 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3cdcabb9-ce5f-4aa1-91d9-646c82224155 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:28.935375 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3cdcabb9-ce5f-4aa1-91d9-646c82224155 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:28.936919 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3cdcabb9-ce5f-4aa1-91d9-646c82224155 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:28.937566 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3cdcabb9-ce5f-4aa1-91d9-646c82224155 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:28.947249 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-74ce0842-1e51-44fe-aab9-691790ab092d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "DELETE /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 204 len: 0 microversion: 2.1 time: 0.370050 Jul 12 17:40:28.948219 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 98/176] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 12 17:40:28 2022] DELETE /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 17:40:28.958705 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-aa97b686-94c4-40d2-aa48-7daee0b55bab tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:28.959703 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-aa97b686-94c4-40d2-aa48-7daee0b55bab tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:28.966499 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-aa97b686-94c4-40d2-aa48-7daee0b55bab tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:28.971088 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-aa97b686-94c4-40d2-aa48-7daee0b55bab tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:28.971088 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-aa97b686-94c4-40d2-aa48-7daee0b55bab tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:28.971088 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-aa97b686-94c4-40d2-aa48-7daee0b55bab tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:28.990190 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:40:29.099690 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-3cdcabb9-ce5f-4aa1-91d9-646c82224155 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:29.107661 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-3cdcabb9-ce5f-4aa1-91d9-646c82224155 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.184466 Jul 12 17:40:29.108668 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 79/177] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:28 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:40:29.155985 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-aa97b686-94c4-40d2-aa48-7daee0b55bab tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:29.159615 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-ee1a11f1-e938-415b-9303-5c0f1a87ee81 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:29.160259 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-ee1a11f1-e938-415b-9303-5c0f1a87ee81 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:29.165805 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-aa97b686-94c4-40d2-aa48-7daee0b55bab tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1554 microversion: 2.1 time: 0.211879 Jul 12 17:40:29.166408 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 99/178] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:28 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1554 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:40:29.166628 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ee1a11f1-e938-415b-9303-5c0f1a87ee81 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:29.166998 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ee1a11f1-e938-415b-9303-5c0f1a87ee81 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:29.167855 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ee1a11f1-e938-415b-9303-5c0f1a87ee81 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:29.168292 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ee1a11f1-e938-415b-9303-5c0f1a87ee81 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:29.320301 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ee1a11f1-e938-415b-9303-5c0f1a87ee81 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:29.328854 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-ee1a11f1-e938-415b-9303-5c0f1a87ee81 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1314 microversion: 2.1 time: 0.173067 Jul 12 17:40:29.331050 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 80/179] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:29 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:40:30.127138 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-3f0cfb74-46a3-4682-ba79-d61f7c7d2067 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:30.127860 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-3f0cfb74-46a3-4682-ba79-d61f7c7d2067 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:30.135016 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3f0cfb74-46a3-4682-ba79-d61f7c7d2067 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:30.135554 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3f0cfb74-46a3-4682-ba79-d61f7c7d2067 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:30.136393 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3f0cfb74-46a3-4682-ba79-d61f7c7d2067 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:30.136843 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3f0cfb74-46a3-4682-ba79-d61f7c7d2067 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:30.193817 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-d3067df8-8c4b-4e29-b516-1ae61f4cec1d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:30.194545 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-d3067df8-8c4b-4e29-b516-1ae61f4cec1d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:30.201960 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d3067df8-8c4b-4e29-b516-1ae61f4cec1d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:30.202517 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d3067df8-8c4b-4e29-b516-1ae61f4cec1d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:30.203228 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d3067df8-8c4b-4e29-b516-1ae61f4cec1d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:30.203669 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d3067df8-8c4b-4e29-b516-1ae61f4cec1d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:30.279308 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-3f0cfb74-46a3-4682-ba79-d61f7c7d2067 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:30.287010 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-3f0cfb74-46a3-4682-ba79-d61f7c7d2067 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.165002 Jul 12 17:40:30.287604 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 100/180] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:30 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:30.345714 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-d3067df8-8c4b-4e29-b516-1ae61f4cec1d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:30.346355 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-f57d100a-13e4-4db5-930a-bacb362b4000 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:30.347143 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-f57d100a-13e4-4db5-930a-bacb362b4000 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:30.353500 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f57d100a-13e4-4db5-930a-bacb362b4000 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:30.353943 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f57d100a-13e4-4db5-930a-bacb362b4000 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:30.354184 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-d3067df8-8c4b-4e29-b516-1ae61f4cec1d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1554 microversion: 2.1 time: 0.165708 Jul 12 17:40:30.354888 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 81/181] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:30 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:30.355130 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f57d100a-13e4-4db5-930a-bacb362b4000 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:30.355615 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f57d100a-13e4-4db5-930a-bacb362b4000 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:30.505346 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-f57d100a-13e4-4db5-930a-bacb362b4000 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:30.513042 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-f57d100a-13e4-4db5-930a-bacb362b4000 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1314 microversion: 2.1 time: 0.170490 Jul 12 17:40:30.513682 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 101/182] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:30 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:31.306959 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-64031e8e-8f3e-462b-a329-1d2e835c8936 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:31.307928 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-64031e8e-8f3e-462b-a329-1d2e835c8936 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:31.316514 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-64031e8e-8f3e-462b-a329-1d2e835c8936 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:31.316960 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-64031e8e-8f3e-462b-a329-1d2e835c8936 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:31.317736 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-64031e8e-8f3e-462b-a329-1d2e835c8936 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:31.318262 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-64031e8e-8f3e-462b-a329-1d2e835c8936 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:31.374613 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ff66e092-22a4-4ef2-bc29-ea75a5cbe98a tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:31.375331 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-ff66e092-22a4-4ef2-bc29-ea75a5cbe98a tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:31.381944 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ff66e092-22a4-4ef2-bc29-ea75a5cbe98a tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:31.382376 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ff66e092-22a4-4ef2-bc29-ea75a5cbe98a tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:31.383195 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ff66e092-22a4-4ef2-bc29-ea75a5cbe98a tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:31.383706 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ff66e092-22a4-4ef2-bc29-ea75a5cbe98a tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:31.499986 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-64031e8e-8f3e-462b-a329-1d2e835c8936 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:31.508682 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-64031e8e-8f3e-462b-a329-1d2e835c8936 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.207995 Jul 12 17:40:31.509666 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 82/183] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:31 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:31.535309 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-354b9599-cccb-4132-8375-e62f20ad4533 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:31.536391 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-354b9599-cccb-4132-8375-e62f20ad4533 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:31.548013 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-354b9599-cccb-4132-8375-e62f20ad4533 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:31.549009 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-354b9599-cccb-4132-8375-e62f20ad4533 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:31.550368 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-354b9599-cccb-4132-8375-e62f20ad4533 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:31.551185 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-354b9599-cccb-4132-8375-e62f20ad4533 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:31.595845 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-ff66e092-22a4-4ef2-bc29-ea75a5cbe98a tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:31.608469 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-ff66e092-22a4-4ef2-bc29-ea75a5cbe98a tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1554 microversion: 2.1 time: 0.238827 Jul 12 17:40:31.609275 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 102/184] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:31 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1554 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:40:31.756010 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-354b9599-cccb-4132-8375-e62f20ad4533 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:31.765244 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-354b9599-cccb-4132-8375-e62f20ad4533 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1314 microversion: 2.1 time: 0.236892 Jul 12 17:40:31.775256 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 83/185] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:31 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:32.529364 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ed1827c5-ad9f-4c9c-8d22-50de497057cc tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:32.530995 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-ed1827c5-ad9f-4c9c-8d22-50de497057cc tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:32.537206 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ed1827c5-ad9f-4c9c-8d22-50de497057cc tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:32.537657 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ed1827c5-ad9f-4c9c-8d22-50de497057cc tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:32.538421 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ed1827c5-ad9f-4c9c-8d22-50de497057cc tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:32.538880 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ed1827c5-ad9f-4c9c-8d22-50de497057cc tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:32.627379 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-483acd9f-17f8-4b79-9218-2e704aa41820 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:32.628162 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-483acd9f-17f8-4b79-9218-2e704aa41820 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:32.635262 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-483acd9f-17f8-4b79-9218-2e704aa41820 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:32.635720 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-483acd9f-17f8-4b79-9218-2e704aa41820 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:32.636505 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-483acd9f-17f8-4b79-9218-2e704aa41820 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:32.636942 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-483acd9f-17f8-4b79-9218-2e704aa41820 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:32.696477 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-ed1827c5-ad9f-4c9c-8d22-50de497057cc tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:32.709252 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-ed1827c5-ad9f-4c9c-8d22-50de497057cc tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.183417 Jul 12 17:40:32.710315 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 103/186] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:32 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:40:32.786784 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-fd2cb9d3-6542-498c-8653-841fc6ea06ff tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:32.787402 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-fd2cb9d3-6542-498c-8653-841fc6ea06ff tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:32.788618 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-483acd9f-17f8-4b79-9218-2e704aa41820 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:32.794136 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fd2cb9d3-6542-498c-8653-841fc6ea06ff tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:32.794622 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fd2cb9d3-6542-498c-8653-841fc6ea06ff tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:32.795506 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fd2cb9d3-6542-498c-8653-841fc6ea06ff tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:32.795922 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fd2cb9d3-6542-498c-8653-841fc6ea06ff tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:32.799171 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-483acd9f-17f8-4b79-9218-2e704aa41820 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1554 microversion: 2.1 time: 0.175732 Jul 12 17:40:32.799873 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 84/187] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:32 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:40:32.947623 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-fd2cb9d3-6542-498c-8653-841fc6ea06ff tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:32.956186 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-fd2cb9d3-6542-498c-8653-841fc6ea06ff tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1314 microversion: 2.1 time: 0.175908 Jul 12 17:40:32.956787 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 104/188] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:32 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:33.728729 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-bfed62c3-050c-4585-8fb1-1e01846b4b7e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:33.729583 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-bfed62c3-050c-4585-8fb1-1e01846b4b7e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:33.737363 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bfed62c3-050c-4585-8fb1-1e01846b4b7e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:33.737807 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bfed62c3-050c-4585-8fb1-1e01846b4b7e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:33.738634 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bfed62c3-050c-4585-8fb1-1e01846b4b7e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:33.739067 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bfed62c3-050c-4585-8fb1-1e01846b4b7e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:33.821724 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-27fbc58c-8278-4f6e-8e72-f025ceac1650 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:33.822953 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-27fbc58c-8278-4f6e-8e72-f025ceac1650 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:33.833584 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-27fbc58c-8278-4f6e-8e72-f025ceac1650 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:33.834497 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-27fbc58c-8278-4f6e-8e72-f025ceac1650 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:33.835845 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-27fbc58c-8278-4f6e-8e72-f025ceac1650 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:33.836614 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-27fbc58c-8278-4f6e-8e72-f025ceac1650 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:33.898895 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-bfed62c3-050c-4585-8fb1-1e01846b4b7e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:33.908090 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-bfed62c3-050c-4585-8fb1-1e01846b4b7e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.183460 Jul 12 17:40:33.908719 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 85/189] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:33 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:40:33.976346 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-5e804323-6bc8-4e9f-9bff-75095c280245 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:33.977162 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-5e804323-6bc8-4e9f-9bff-75095c280245 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:33.985286 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5e804323-6bc8-4e9f-9bff-75095c280245 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:33.985782 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5e804323-6bc8-4e9f-9bff-75095c280245 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:33.986656 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5e804323-6bc8-4e9f-9bff-75095c280245 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:33.987321 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5e804323-6bc8-4e9f-9bff-75095c280245 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:34.022701 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-27fbc58c-8278-4f6e-8e72-f025ceac1650 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:34.033092 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-27fbc58c-8278-4f6e-8e72-f025ceac1650 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1554 microversion: 2.1 time: 0.218809 Jul 12 17:40:34.033850 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 105/190] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:33 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1554 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:34.406470 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-5e804323-6bc8-4e9f-9bff-75095c280245 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:34.415208 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-5e804323-6bc8-4e9f-9bff-75095c280245 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1314 microversion: 2.1 time: 0.443738 Jul 12 17:40:34.415824 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 86/191] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:33 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:40:34.926255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-d48a1a69-53c8-4998-acc7-5efad466758e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:34.927135 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-d48a1a69-53c8-4998-acc7-5efad466758e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:34.936315 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d48a1a69-53c8-4998-acc7-5efad466758e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:34.936948 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d48a1a69-53c8-4998-acc7-5efad466758e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:34.938117 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d48a1a69-53c8-4998-acc7-5efad466758e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:34.939112 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d48a1a69-53c8-4998-acc7-5efad466758e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:35.049920 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-4fd8d531-fd89-4dff-b0ad-b952666d5a6c tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:35.050589 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-4fd8d531-fd89-4dff-b0ad-b952666d5a6c tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:35.057875 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4fd8d531-fd89-4dff-b0ad-b952666d5a6c tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:35.058346 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4fd8d531-fd89-4dff-b0ad-b952666d5a6c tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:35.059222 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4fd8d531-fd89-4dff-b0ad-b952666d5a6c tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:35.059650 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4fd8d531-fd89-4dff-b0ad-b952666d5a6c tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:35.105958 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-d48a1a69-53c8-4998-acc7-5efad466758e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:35.118450 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-d48a1a69-53c8-4998-acc7-5efad466758e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.196142 Jul 12 17:40:35.119521 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 106/192] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:34 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:35.223744 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-4fd8d531-fd89-4dff-b0ad-b952666d5a6c tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:35.232741 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-4fd8d531-fd89-4dff-b0ad-b952666d5a6c tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1554 microversion: 2.1 time: 0.186605 Jul 12 17:40:35.233855 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 87/193] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:35 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1554 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:40:35.433426 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-5d6c428e-fb66-4a6a-b83c-5a2138a9b68f tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:35.436574 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-5d6c428e-fb66-4a6a-b83c-5a2138a9b68f tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:35.441027 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5d6c428e-fb66-4a6a-b83c-5a2138a9b68f tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:35.441460 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5d6c428e-fb66-4a6a-b83c-5a2138a9b68f tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:35.442254 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5d6c428e-fb66-4a6a-b83c-5a2138a9b68f tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:35.442782 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5d6c428e-fb66-4a6a-b83c-5a2138a9b68f tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:35.605993 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-5d6c428e-fb66-4a6a-b83c-5a2138a9b68f tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:35.615190 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-5d6c428e-fb66-4a6a-b83c-5a2138a9b68f tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1314 microversion: 2.1 time: 0.185661 Jul 12 17:40:35.615826 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 107/194] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:35 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:36.149850 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-4706df9e-4939-4fa9-a38e-2f11afb54927 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:36.151585 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-4706df9e-4939-4fa9-a38e-2f11afb54927 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:36.163397 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4706df9e-4939-4fa9-a38e-2f11afb54927 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:36.164165 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4706df9e-4939-4fa9-a38e-2f11afb54927 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:36.165477 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4706df9e-4939-4fa9-a38e-2f11afb54927 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:36.166342 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4706df9e-4939-4fa9-a38e-2f11afb54927 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:36.256392 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-282e9c80-5493-40a6-8064-9ba8e903c8d3 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:36.257514 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-282e9c80-5493-40a6-8064-9ba8e903c8d3 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:36.277653 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-282e9c80-5493-40a6-8064-9ba8e903c8d3 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:36.278424 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-282e9c80-5493-40a6-8064-9ba8e903c8d3 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:36.279987 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-282e9c80-5493-40a6-8064-9ba8e903c8d3 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:36.280768 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-282e9c80-5493-40a6-8064-9ba8e903c8d3 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:36.363950 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-4706df9e-4939-4fa9-a38e-2f11afb54927 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:36.378713 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-4706df9e-4939-4fa9-a38e-2f11afb54927 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.238984 Jul 12 17:40:36.379656 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 88/195] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:36 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:40:36.479813 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-282e9c80-5493-40a6-8064-9ba8e903c8d3 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:36.489014 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-282e9c80-5493-40a6-8064-9ba8e903c8d3 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1554 microversion: 2.1 time: 0.241283 Jul 12 17:40:36.489634 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 108/196] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:36 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1554 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:36.635694 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b8782965-748f-4d8a-b3b8-fa6c154a3259 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:36.636309 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-b8782965-748f-4d8a-b3b8-fa6c154a3259 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:36.643204 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b8782965-748f-4d8a-b3b8-fa6c154a3259 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:36.643680 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b8782965-748f-4d8a-b3b8-fa6c154a3259 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:36.644466 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b8782965-748f-4d8a-b3b8-fa6c154a3259 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:36.644906 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b8782965-748f-4d8a-b3b8-fa6c154a3259 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:36.814517 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-b8782965-748f-4d8a-b3b8-fa6c154a3259 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:36.823733 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-b8782965-748f-4d8a-b3b8-fa6c154a3259 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1314 microversion: 2.1 time: 0.191863 Jul 12 17:40:36.825399 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 89/197] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:36 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:37.401247 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-deb45ae5-268f-4624-9465-cbc876880d9d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:37.401953 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-deb45ae5-268f-4624-9465-cbc876880d9d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:37.408778 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-deb45ae5-268f-4624-9465-cbc876880d9d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:37.409380 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-deb45ae5-268f-4624-9465-cbc876880d9d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:37.410188 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-deb45ae5-268f-4624-9465-cbc876880d9d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:37.410671 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-deb45ae5-268f-4624-9465-cbc876880d9d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:37.522112 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-39d1628f-d142-428d-bcc0-1f7028c734bc tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:37.522793 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-39d1628f-d142-428d-bcc0-1f7028c734bc tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:37.530352 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-39d1628f-d142-428d-bcc0-1f7028c734bc tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:37.531265 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-39d1628f-d142-428d-bcc0-1f7028c734bc tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:37.532450 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-39d1628f-d142-428d-bcc0-1f7028c734bc tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:37.533125 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-39d1628f-d142-428d-bcc0-1f7028c734bc tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:37.597760 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-deb45ae5-268f-4624-9465-cbc876880d9d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:37.608213 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-deb45ae5-268f-4624-9465-cbc876880d9d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.211403 Jul 12 17:40:37.609053 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 109/198] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:37 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:40:37.705645 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-39d1628f-d142-428d-bcc0-1f7028c734bc tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:37.714485 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-39d1628f-d142-428d-bcc0-1f7028c734bc tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1554 microversion: 2.1 time: 0.209562 Jul 12 17:40:37.715067 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 90/199] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:37 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1554 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:37.847477 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ae78856b-e53a-4f8a-b2ab-5e5b50bc5ec2 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:37.848389 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-ae78856b-e53a-4f8a-b2ab-5e5b50bc5ec2 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:37.852133 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:40:37.857925 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ae78856b-e53a-4f8a-b2ab-5e5b50bc5ec2 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:37.858824 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ae78856b-e53a-4f8a-b2ab-5e5b50bc5ec2 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:37.860059 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ae78856b-e53a-4f8a-b2ab-5e5b50bc5ec2 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:37.861058 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ae78856b-e53a-4f8a-b2ab-5e5b50bc5ec2 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:38.039322 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-ae78856b-e53a-4f8a-b2ab-5e5b50bc5ec2 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:38.054003 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-ae78856b-e53a-4f8a-b2ab-5e5b50bc5ec2 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1497 microversion: 2.1 time: 0.214594 Jul 12 17:40:38.054869 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 110/200] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:37 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1497 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:38.626663 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-0fd8fb1a-e8d0-4825-b996-0265087e3544 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:38.627294 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-0fd8fb1a-e8d0-4825-b996-0265087e3544 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:38.634288 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0fd8fb1a-e8d0-4825-b996-0265087e3544 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:38.634754 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0fd8fb1a-e8d0-4825-b996-0265087e3544 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:38.635533 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0fd8fb1a-e8d0-4825-b996-0265087e3544 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:38.635968 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0fd8fb1a-e8d0-4825-b996-0265087e3544 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:38.653631 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=100 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:40:38.741684 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-fc0d2640-a826-459b-96ba-1848186371b1 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:38.744741 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-fc0d2640-a826-459b-96ba-1848186371b1 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:38.753813 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fc0d2640-a826-459b-96ba-1848186371b1 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:38.754648 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fc0d2640-a826-459b-96ba-1848186371b1 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:38.755531 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fc0d2640-a826-459b-96ba-1848186371b1 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:38.756027 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fc0d2640-a826-459b-96ba-1848186371b1 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:38.829469 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-fc0d2640-a826-459b-96ba-1848186371b1 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:38.838755 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-fc0d2640-a826-459b-96ba-1848186371b1 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1512 microversion: 2.1 time: 0.102758 Jul 12 17:40:38.839360 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 111/201] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:38 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1512 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:38.845346 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-a96c4a66-de2d-476c-9e4a-7823ce43ffdf req-5afb1431-da15-4fed-86f0-6c013700b428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "407f15c2-26ad-460c-b4cd-281bc67c5c0d", "name": "network-vif-deleted", "tag": "51b4a1d7-d75e-4513-9fce-09137564d4ec"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:40:38.856090 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-a96c4a66-de2d-476c-9e4a-7823ce43ffdf req-5afb1431-da15-4fed-86f0-6c013700b428 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:38.856849 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-a96c4a66-de2d-476c-9e4a-7823ce43ffdf req-5afb1431-da15-4fed-86f0-6c013700b428 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:38.871181 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-a96c4a66-de2d-476c-9e4a-7823ce43ffdf req-5afb1431-da15-4fed-86f0-6c013700b428 service nova] Creating event network-vif-deleted:51b4a1d7-d75e-4513-9fce-09137564d4ec for instance 407f15c2-26ad-460c-b4cd-281bc67c5c0d on hv-cinder-84875 Jul 12 17:40:38.877606 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-a96c4a66-de2d-476c-9e4a-7823ce43ffdf req-5afb1431-da15-4fed-86f0-6c013700b428 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036549 Jul 12 17:40:38.878587 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 112/202] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:40:38.883240 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0fd8fb1a-e8d0-4825-b996-0265087e3544 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:38.891546 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-0fd8fb1a-e8d0-4825-b996-0265087e3544 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.269362 Jul 12 17:40:38.892369 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 91/203] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:38 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:39.677260 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-6c645000-076d-4f39-b80e-1b655f275691 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:39.677844 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-6c645000-076d-4f39-b80e-1b655f275691 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:39.684625 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6c645000-076d-4f39-b80e-1b655f275691 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:39.685694 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6c645000-076d-4f39-b80e-1b655f275691 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:39.686736 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6c645000-076d-4f39-b80e-1b655f275691 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:39.687184 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6c645000-076d-4f39-b80e-1b655f275691 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:39.715364 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-6c645000-076d-4f39-b80e-1b655f275691 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Going to try to terminate instance {{(pid=130059) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:40:39.860692 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-8987919a-6cfa-4f51-9cdb-bd247c07a84b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:39.861330 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-8987919a-6cfa-4f51-9cdb-bd247c07a84b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:39.868739 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8987919a-6cfa-4f51-9cdb-bd247c07a84b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:39.869226 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8987919a-6cfa-4f51-9cdb-bd247c07a84b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:39.870273 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8987919a-6cfa-4f51-9cdb-bd247c07a84b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:39.870946 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8987919a-6cfa-4f51-9cdb-bd247c07a84b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:39.937947 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-8987919a-6cfa-4f51-9cdb-bd247c07a84b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:39.947010 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-8987919a-6cfa-4f51-9cdb-bd247c07a84b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1346 microversion: 2.1 time: 0.092040 Jul 12 17:40:39.947596 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 92/204] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:39 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1346 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:39.960100 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-196a5302-a0d0-4824-820c-1de5988446a3 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:39.960100 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-196a5302-a0d0-4824-820c-1de5988446a3 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:39.962884 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-196a5302-a0d0-4824-820c-1de5988446a3 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:39.963414 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-196a5302-a0d0-4824-820c-1de5988446a3 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:39.964175 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-196a5302-a0d0-4824-820c-1de5988446a3 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:39.964745 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-196a5302-a0d0-4824-820c-1de5988446a3 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:39.996842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-6c645000-076d-4f39-b80e-1b655f275691 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 204 len: 0 microversion: 2.1 time: 0.323676 Jul 12 17:40:39.997545 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 113/205] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 12 17:40:39 2022] DELETE /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:40:40.009982 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-e669055d-4b9e-4efe-8278-5f8a19f14ea5 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:40.011030 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-e669055d-4b9e-4efe-8278-5f8a19f14ea5 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:40.018323 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e669055d-4b9e-4efe-8278-5f8a19f14ea5 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:40.018847 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e669055d-4b9e-4efe-8278-5f8a19f14ea5 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:40.019673 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e669055d-4b9e-4efe-8278-5f8a19f14ea5 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:40.020112 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e669055d-4b9e-4efe-8278-5f8a19f14ea5 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:40.136987 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-196a5302-a0d0-4824-820c-1de5988446a3 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:40.146505 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-196a5302-a0d0-4824-820c-1de5988446a3 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.197734 Jul 12 17:40:40.147110 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 93/206] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:39 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:40.186539 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-e669055d-4b9e-4efe-8278-5f8a19f14ea5 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:40.200356 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-e669055d-4b9e-4efe-8278-5f8a19f14ea5 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1503 microversion: 2.1 time: 0.194245 Jul 12 17:40:40.205049 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 114/207] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:40 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1503 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:40:40.967041 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-44e3dd25-061f-4f84-a1bb-8f6d8a2ac5fd tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:40.967695 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-44e3dd25-061f-4f84-a1bb-8f6d8a2ac5fd tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:40.974699 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-44e3dd25-061f-4f84-a1bb-8f6d8a2ac5fd tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:40.975130 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-44e3dd25-061f-4f84-a1bb-8f6d8a2ac5fd tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:40.975914 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-44e3dd25-061f-4f84-a1bb-8f6d8a2ac5fd tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:40.976395 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-44e3dd25-061f-4f84-a1bb-8f6d8a2ac5fd tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:41.045726 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-44e3dd25-061f-4f84-a1bb-8f6d8a2ac5fd tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:41.054541 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-44e3dd25-061f-4f84-a1bb-8f6d8a2ac5fd tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1346 microversion: 2.1 time: 0.091489 Jul 12 17:40:41.055368 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 94/208] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:40 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1346 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:41.172748 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-442531c0-460d-4bf3-80e6-f8a1ec7ee099 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:41.173415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-442531c0-460d-4bf3-80e6-f8a1ec7ee099 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:41.179556 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-442531c0-460d-4bf3-80e6-f8a1ec7ee099 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:41.180011 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-442531c0-460d-4bf3-80e6-f8a1ec7ee099 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:41.180817 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-442531c0-460d-4bf3-80e6-f8a1ec7ee099 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:41.181259 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-442531c0-460d-4bf3-80e6-f8a1ec7ee099 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:41.185638 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:40:41.223408 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-94ed2e5c-9717-4909-a6f9-315a41b0d938 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:41.224026 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-94ed2e5c-9717-4909-a6f9-315a41b0d938 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:41.230247 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-94ed2e5c-9717-4909-a6f9-315a41b0d938 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:41.230733 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-94ed2e5c-9717-4909-a6f9-315a41b0d938 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:41.231595 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-94ed2e5c-9717-4909-a6f9-315a41b0d938 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:41.232717 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-94ed2e5c-9717-4909-a6f9-315a41b0d938 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:41.322850 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-442531c0-460d-4bf3-80e6-f8a1ec7ee099 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:41.330662 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-442531c0-460d-4bf3-80e6-f8a1ec7ee099 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.162892 Jul 12 17:40:41.331246 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 115/209] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:41 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:41.367843 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-94ed2e5c-9717-4909-a6f9-315a41b0d938 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:41.375502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-94ed2e5c-9717-4909-a6f9-315a41b0d938 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1503 microversion: 2.1 time: 0.156013 Jul 12 17:40:41.376099 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 95/210] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:41 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:40:42.074283 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ac2146bd-fe80-439a-9f2a-6baef2b34fa5 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:42.074917 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-ac2146bd-fe80-439a-9f2a-6baef2b34fa5 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:42.082341 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ac2146bd-fe80-439a-9f2a-6baef2b34fa5 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:42.082821 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ac2146bd-fe80-439a-9f2a-6baef2b34fa5 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:42.083604 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ac2146bd-fe80-439a-9f2a-6baef2b34fa5 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:42.084035 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ac2146bd-fe80-439a-9f2a-6baef2b34fa5 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:42.147818 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-ac2146bd-fe80-439a-9f2a-6baef2b34fa5 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:42.156146 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-ac2146bd-fe80-439a-9f2a-6baef2b34fa5 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1346 microversion: 2.1 time: 0.085674 Jul 12 17:40:42.156854 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 116/211] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:42 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:42.347385 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-430b78e4-3e50-4b7d-8c74-4ca618893bc6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:42.347924 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-430b78e4-3e50-4b7d-8c74-4ca618893bc6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:42.354623 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-430b78e4-3e50-4b7d-8c74-4ca618893bc6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:42.355078 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-430b78e4-3e50-4b7d-8c74-4ca618893bc6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:42.355845 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-430b78e4-3e50-4b7d-8c74-4ca618893bc6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:42.356288 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-430b78e4-3e50-4b7d-8c74-4ca618893bc6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:42.393200 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-29f6c5e9-379a-413c-8146-bbe5cd9bea92 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:42.393845 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-29f6c5e9-379a-413c-8146-bbe5cd9bea92 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:42.400347 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-29f6c5e9-379a-413c-8146-bbe5cd9bea92 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:42.401031 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-29f6c5e9-379a-413c-8146-bbe5cd9bea92 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:42.401813 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-29f6c5e9-379a-413c-8146-bbe5cd9bea92 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:42.402246 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-29f6c5e9-379a-413c-8146-bbe5cd9bea92 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:42.501121 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-430b78e4-3e50-4b7d-8c74-4ca618893bc6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:42.509350 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-430b78e4-3e50-4b7d-8c74-4ca618893bc6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.165959 Jul 12 17:40:42.509925 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 96/212] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:42 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:42.542204 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-29f6c5e9-379a-413c-8146-bbe5cd9bea92 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:42.550920 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-29f6c5e9-379a-413c-8146-bbe5cd9bea92 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1503 microversion: 2.1 time: 0.162137 Jul 12 17:40:42.551516 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 117/213] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:42 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:40:43.173534 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-24353706-7e42-4a1e-be94-d9b1e4915d8b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:43.174149 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-24353706-7e42-4a1e-be94-d9b1e4915d8b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:43.180584 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-24353706-7e42-4a1e-be94-d9b1e4915d8b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:43.181041 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-24353706-7e42-4a1e-be94-d9b1e4915d8b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:43.181827 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-24353706-7e42-4a1e-be94-d9b1e4915d8b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:43.182317 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-24353706-7e42-4a1e-be94-d9b1e4915d8b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:43.254295 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-24353706-7e42-4a1e-be94-d9b1e4915d8b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:43.266156 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-24353706-7e42-4a1e-be94-d9b1e4915d8b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1346 microversion: 2.1 time: 0.096918 Jul 12 17:40:43.270669 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 97/214] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:43 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:43.526241 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-5cda8951-aff0-401c-afa2-73ddac61d486 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:43.526869 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-5cda8951-aff0-401c-afa2-73ddac61d486 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:43.533298 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5cda8951-aff0-401c-afa2-73ddac61d486 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:43.533738 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5cda8951-aff0-401c-afa2-73ddac61d486 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:43.534578 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5cda8951-aff0-401c-afa2-73ddac61d486 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:43.535004 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5cda8951-aff0-401c-afa2-73ddac61d486 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:43.571459 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-13bc15d0-cc9f-4f0e-854f-a35a4b332573 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:43.572415 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-13bc15d0-cc9f-4f0e-854f-a35a4b332573 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:43.584246 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-13bc15d0-cc9f-4f0e-854f-a35a4b332573 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:43.585448 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-13bc15d0-cc9f-4f0e-854f-a35a4b332573 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:43.587076 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-13bc15d0-cc9f-4f0e-854f-a35a4b332573 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:43.588721 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-13bc15d0-cc9f-4f0e-854f-a35a4b332573 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:43.729021 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-5cda8951-aff0-401c-afa2-73ddac61d486 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:43.738130 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-5cda8951-aff0-401c-afa2-73ddac61d486 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.215769 Jul 12 17:40:43.738827 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 118/215] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:43 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:43.758157 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-13bc15d0-cc9f-4f0e-854f-a35a4b332573 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:43.771947 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-13bc15d0-cc9f-4f0e-854f-a35a4b332573 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1503 microversion: 2.1 time: 0.206679 Jul 12 17:40:43.774587 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 98/216] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:43 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1503 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:40:44.301560 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-cffcf247-37be-41de-b850-7f43fbb7e41b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:44.305588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-cffcf247-37be-41de-b850-7f43fbb7e41b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:44.314885 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cffcf247-37be-41de-b850-7f43fbb7e41b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:44.316607 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cffcf247-37be-41de-b850-7f43fbb7e41b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:44.317419 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cffcf247-37be-41de-b850-7f43fbb7e41b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:44.317877 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cffcf247-37be-41de-b850-7f43fbb7e41b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:44.394487 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-cffcf247-37be-41de-b850-7f43fbb7e41b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:44.402745 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-cffcf247-37be-41de-b850-7f43fbb7e41b tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1346 microversion: 2.1 time: 0.107760 Jul 12 17:40:44.403257 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 119/217] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:44 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1346 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:44.761547 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-9a87064c-0c23-4fbb-b89a-1cc47196993e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:44.767671 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-9a87064c-0c23-4fbb-b89a-1cc47196993e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:44.792320 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a3885a10-f3cf-4857-b294-47ae7b6a46c8 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:44.793798 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-a3885a10-f3cf-4857-b294-47ae7b6a46c8 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:44.800040 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9a87064c-0c23-4fbb-b89a-1cc47196993e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:44.800830 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9a87064c-0c23-4fbb-b89a-1cc47196993e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:44.802594 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9a87064c-0c23-4fbb-b89a-1cc47196993e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:44.803621 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9a87064c-0c23-4fbb-b89a-1cc47196993e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:44.806607 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a3885a10-f3cf-4857-b294-47ae7b6a46c8 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:44.811435 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a3885a10-f3cf-4857-b294-47ae7b6a46c8 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:44.812656 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a3885a10-f3cf-4857-b294-47ae7b6a46c8 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:44.815719 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a3885a10-f3cf-4857-b294-47ae7b6a46c8 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:45.065529 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a3885a10-f3cf-4857-b294-47ae7b6a46c8 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:45.083580 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-a3885a10-f3cf-4857-b294-47ae7b6a46c8 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1503 microversion: 2.1 time: 0.295068 Jul 12 17:40:45.098332 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 120/218] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:44 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1503 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:45.112370 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-9a87064c-0c23-4fbb-b89a-1cc47196993e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:45.136133 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-9a87064c-0c23-4fbb-b89a-1cc47196993e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.383096 Jul 12 17:40:45.137413 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 99/219] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:44 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:40:45.420450 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-3d554a04-1657-42e9-a93e-16db9012825d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:45.421304 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-3d554a04-1657-42e9-a93e-16db9012825d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:45.429259 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3d554a04-1657-42e9-a93e-16db9012825d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:45.429844 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3d554a04-1657-42e9-a93e-16db9012825d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:45.430907 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3d554a04-1657-42e9-a93e-16db9012825d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:45.431489 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3d554a04-1657-42e9-a93e-16db9012825d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:45.471903 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3d554a04-1657-42e9-a93e-16db9012825d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:45.472356 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3d554a04-1657-42e9-a93e-16db9012825d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:45.472821 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.objects.instance [None req-3d554a04-1657-42e9-a93e-16db9012825d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lazy-loading 'fault' on Instance uuid 407f15c2-26ad-460c-b4cd-281bc67c5c0d {{(pid=130059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:40:45.536944 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-3d554a04-1657-42e9-a93e-16db9012825d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:45.553532 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-3d554a04-1657-42e9-a93e-16db9012825d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1351 microversion: 2.1 time: 0.137580 Jul 12 17:40:45.556284 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 121/220] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:45 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1351 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:45.598258 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-795646f8-c8d9-48db-8b14-130d93633ed1 req-2555c397-e0b3-412a-94bb-59cadb681a74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9373a853-2fb9-427e-ba44-ec2825f27098", "name": "network-vif-deleted", "tag": "77f4fa9f-c3dc-4191-a0cb-7038ffe804e4"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:40:45.607884 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-795646f8-c8d9-48db-8b14-130d93633ed1 req-2555c397-e0b3-412a-94bb-59cadb681a74 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:45.608547 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-795646f8-c8d9-48db-8b14-130d93633ed1 req-2555c397-e0b3-412a-94bb-59cadb681a74 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:45.620981 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-795646f8-c8d9-48db-8b14-130d93633ed1 req-2555c397-e0b3-412a-94bb-59cadb681a74 service nova] Creating event network-vif-deleted:77f4fa9f-c3dc-4191-a0cb-7038ffe804e4 for instance 9373a853-2fb9-427e-ba44-ec2825f27098 on hv-cinder-84875 Jul 12 17:40:45.626565 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-795646f8-c8d9-48db-8b14-130d93633ed1 req-2555c397-e0b3-412a-94bb-59cadb681a74 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031968 Jul 12 17:40:45.627804 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 100/221] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:40:46.105186 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-036574a8-70e1-4862-b4bb-c43c6e251d31 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:46.105794 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-036574a8-70e1-4862-b4bb-c43c6e251d31 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:46.116457 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-036574a8-70e1-4862-b4bb-c43c6e251d31 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:46.116921 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-036574a8-70e1-4862-b4bb-c43c6e251d31 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:46.117859 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-036574a8-70e1-4862-b4bb-c43c6e251d31 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:46.118283 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-036574a8-70e1-4862-b4bb-c43c6e251d31 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:46.164417 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-6699402e-af9e-4cbc-b6c5-058c91f70c19 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:46.165469 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-6699402e-af9e-4cbc-b6c5-058c91f70c19 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:46.167607 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_api:SELECT=70 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:40:46.181315 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6699402e-af9e-4cbc-b6c5-058c91f70c19 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:46.182003 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6699402e-af9e-4cbc-b6c5-058c91f70c19 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:46.182725 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6699402e-af9e-4cbc-b6c5-058c91f70c19 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:46.183458 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6699402e-af9e-4cbc-b6c5-058c91f70c19 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:46.191497 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-036574a8-70e1-4862-b4bb-c43c6e251d31 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:46.201716 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-036574a8-70e1-4862-b4bb-c43c6e251d31 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1299 microversion: 2.1 time: 0.100297 Jul 12 17:40:46.202321 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 122/222] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:46 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1299 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:46.424952 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-6699402e-af9e-4cbc-b6c5-058c91f70c19 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:46.432880 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-6699402e-af9e-4cbc-b6c5-058c91f70c19 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.273951 Jul 12 17:40:46.433667 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 101/223] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:46 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:46.573853 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-b9440b1f-8529-4d30-a934-c8cac6a9e20d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:46.574387 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-b9440b1f-8529-4d30-a934-c8cac6a9e20d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:46.581594 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b9440b1f-8529-4d30-a934-c8cac6a9e20d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:46.582054 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b9440b1f-8529-4d30-a934-c8cac6a9e20d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:46.582971 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b9440b1f-8529-4d30-a934-c8cac6a9e20d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:46.583417 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b9440b1f-8529-4d30-a934-c8cac6a9e20d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:46.624858 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b9440b1f-8529-4d30-a934-c8cac6a9e20d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:46.625573 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b9440b1f-8529-4d30-a934-c8cac6a9e20d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:46.626207 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.objects.instance [None req-b9440b1f-8529-4d30-a934-c8cac6a9e20d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lazy-loading 'fault' on Instance uuid 407f15c2-26ad-460c-b4cd-281bc67c5c0d {{(pid=130059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:40:46.682358 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-b9440b1f-8529-4d30-a934-c8cac6a9e20d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79a28d8f774c1fac44185df36cd24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a7a8fa558b472da92a52cdd63bdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:46.697967 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-b9440b1f-8529-4d30-a934-c8cac6a9e20d tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 200 len: 1351 microversion: 2.1 time: 0.127540 Jul 12 17:40:46.699103 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 123/224] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:46 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 1351 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:47.218078 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-26047e7b-21d7-44cc-b40f-7358d3650392 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:47.220451 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-26047e7b-21d7-44cc-b40f-7358d3650392 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:47.225521 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-26047e7b-21d7-44cc-b40f-7358d3650392 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:47.225969 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-26047e7b-21d7-44cc-b40f-7358d3650392 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:47.226778 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-26047e7b-21d7-44cc-b40f-7358d3650392 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:47.227305 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-26047e7b-21d7-44cc-b40f-7358d3650392 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:47.261488 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-26047e7b-21d7-44cc-b40f-7358d3650392 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:47.261942 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-26047e7b-21d7-44cc-b40f-7358d3650392 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:47.262407 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.objects.instance [None req-26047e7b-21d7-44cc-b40f-7358d3650392 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lazy-loading 'fault' on Instance uuid 9373a853-2fb9-427e-ba44-ec2825f27098 {{(pid=130058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:40:47.314683 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-26047e7b-21d7-44cc-b40f-7358d3650392 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:47.322832 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-26047e7b-21d7-44cc-b40f-7358d3650392 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1304 microversion: 2.1 time: 0.108731 Jul 12 17:40:47.323499 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 102/225] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:47 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:47.452819 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-8f8cb21e-d3cb-47b4-bad6-ff7aec9d2786 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:47.454052 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-8f8cb21e-d3cb-47b4-bad6-ff7aec9d2786 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:47.463765 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8f8cb21e-d3cb-47b4-bad6-ff7aec9d2786 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:47.464576 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8f8cb21e-d3cb-47b4-bad6-ff7aec9d2786 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:47.465941 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8f8cb21e-d3cb-47b4-bad6-ff7aec9d2786 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:47.466782 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8f8cb21e-d3cb-47b4-bad6-ff7aec9d2786 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:47.617421 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-8f8cb21e-d3cb-47b4-bad6-ff7aec9d2786 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:47.626388 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-8f8cb21e-d3cb-47b4-bad6-ff7aec9d2786 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1521 microversion: 2.1 time: 0.179009 Jul 12 17:40:47.626990 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 124/226] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:47 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:47.721159 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-4523b292-98a2-4ab8-9088-1a95ee3b90ba tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:47.721972 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-4523b292-98a2-4ab8-9088-1a95ee3b90ba tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:47.730067 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4523b292-98a2-4ab8-9088-1a95ee3b90ba tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:47.730894 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4523b292-98a2-4ab8-9088-1a95ee3b90ba tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:47.731903 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4523b292-98a2-4ab8-9088-1a95ee3b90ba tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:47.733072 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4523b292-98a2-4ab8-9088-1a95ee3b90ba tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:47.750226 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.wsgi [None req-4523b292-98a2-4ab8-9088-1a95ee3b90ba tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] HTTP exception thrown: Instance 407f15c2-26ad-460c-b4cd-281bc67c5c0d could not be found. Jul 12 17:40:47.755657 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-4523b292-98a2-4ab8-9088-1a95ee3b90ba tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Request method failure captured: Jul 12 17:40:47.755657 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: request: GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d HTTP/1.1 Jul 12 17:40:47.755657 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept: application/json Jul 12 17:40:47.755657 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept-Encoding: identity Jul 12 17:40:47.755657 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Connection: close Jul 12 17:40:47.755657 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Length: 0 Jul 12 17:40:47.755657 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Type: application/json Jul 12 17:40:47.755657 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Host: 10.222.0.16 Jul 12 17:40:47.755657 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Openstack-System-Scope: None Jul 12 17:40:47.755657 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: User-Agent: python-urllib3/1.26.9 Jul 12 17:40:47.755657 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Auth-Token: gAAAAABizbHLhOaKy9VkLkNfmF4earV5EFkP0L_lDCJGIpxiXHuhPydTjHpekY8G1b5-USaIQaopb-lPyPZcPKwEqzYwgyDHX_wyjURGrPQiP-9F--ux9TzRaEWNLNX685bKfMcvO-MhInhwO-VrRgwDTCKGsuVo780CCivNA1R39cgxxioBtV4 Jul 12 17:40:47.755657 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Id: None Jul 12 17:40:47.755657 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Name: None Jul 12 17:40:47.755657 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Identity-Status: Confirmed Jul 12 17:40:47.755657 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Is-Admin-Project: True Jul 12 17:40:47.755657 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Id: default Jul 12 17:40:47.755657 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Name: Default Jul 12 17:40:47.755657 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Id: 33a7a8fa558b472da92a52cdd63bdbad Jul 12 17:40:47.755657 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Name: tempest-DeleteServersTestJSON-1889107527 Jul 12 17:40:47.755657 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Role: reader,member Jul 12 17:40:47.755657 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Roles: reader,member Jul 12 17:40:47.757250 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33a7a8fa558b472da92a52cdd63bdbad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_33a7a8fa558b472da92a52cdd63bdbad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33a7a8fa558b472da92a52cdd63bdbad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/33a7a8fa558b472da92a52cdd63bdbad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:40:47.757250 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant: tempest-DeleteServersTestJSON-1889107527 Jul 12 17:40:47.757250 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Id: 33a7a8fa558b472da92a52cdd63bdbad Jul 12 17:40:47.757250 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Name: tempest-DeleteServersTestJSON-1889107527 Jul 12 17:40:47.757250 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User: tempest-DeleteServersTestJSON-1889107527-project Jul 12 17:40:47.757250 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Id: default Jul 12 17:40:47.757250 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Name: Default Jul 12 17:40:47.757250 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Id: cd79a28d8f774c1fac44185df36cd24f Jul 12 17:40:47.757250 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Name: tempest-DeleteServersTestJSON-1889107527-project Jul 12 17:40:47.757250 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: method: > Jul 12 17:40:47.757250 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: exception: Instance 407f15c2-26ad-460c-b4cd-281bc67c5c0d could not be found. Jul 12 17:40:47.757250 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: action_args: {'id': '407f15c2-26ad-460c-b4cd-281bc67c5c0d'} Jul 12 17:40:47.758133 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:40:47.758133 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:40:47.758133 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:40:47.758133 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:40:47.758133 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:40:47.758133 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:40:47.758133 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:40:47.758133 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:40:47.758133 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:40:47.758133 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:40:47.758133 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 407f15c2-26ad-460c-b4cd-281bc67c5c0d could not be found. Jul 12 17:40:47.758133 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:40:47.758133 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:40:47.758133 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:40:47.758133 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:40:47.758133 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:40:47.758133 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:40:47.758133 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:40:47.758133 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:40:47.758133 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:40:47.761156 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:40:47.761156 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:40:47.761156 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:40:47.761156 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:40:47.761156 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:40:47.761156 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:40:47.761156 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:40:47.761156 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 407f15c2-26ad-460c-b4cd-281bc67c5c0d could not be found. Jul 12 17:40:47.761156 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:40:47.761156 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:40:47.761156 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:40:47.761156 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:40:47.761156 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:40:47.761156 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:40:47.761156 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:40:47.761156 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:40:47.761156 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 407f15c2-26ad-460c-b4cd-281bc67c5c0d could not be found. Jul 12 17:40:47.761156 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:40:47.765839 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-4523b292-98a2-4ab8-9088-1a95ee3b90ba tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Returning 404 to user: Instance 407f15c2-26ad-460c-b4cd-281bc67c5c0d could not be found. {{(pid=130058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:40:47.765839 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-4523b292-98a2-4ab8-9088-1a95ee3b90ba tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 404 len: 111 microversion: 2.1 time: 0.045749 Jul 12 17:40:47.765839 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 103/227] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:47 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:40:48.280165 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ec46aeeb-b4dc-4176-a96b-15b4bde5b3eb tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:48.280165 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-ec46aeeb-b4dc-4176-a96b-15b4bde5b3eb tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:48.285149 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ec46aeeb-b4dc-4176-a96b-15b4bde5b3eb tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:48.285708 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ec46aeeb-b4dc-4176-a96b-15b4bde5b3eb tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:48.286697 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ec46aeeb-b4dc-4176-a96b-15b4bde5b3eb tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:48.287368 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ec46aeeb-b4dc-4176-a96b-15b4bde5b3eb tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:48.303184 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-ec46aeeb-b4dc-4176-a96b-15b4bde5b3eb tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] HTTP exception thrown: Instance 407f15c2-26ad-460c-b4cd-281bc67c5c0d could not be found. Jul 12 17:40:48.310038 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ec46aeeb-b4dc-4176-a96b-15b4bde5b3eb tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Request method failure captured: Jul 12 17:40:48.310038 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d/os-volume_attachments HTTP/1.1 Jul 12 17:40:48.310038 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:40:48.310038 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:40:48.310038 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:40:48.310038 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 0 Jul 12 17:40:48.310038 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:40:48.310038 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:40:48.310038 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:40:48.310038 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:40:48.310038 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbHLhOaKy9VkLkNfmF4earV5EFkP0L_lDCJGIpxiXHuhPydTjHpekY8G1b5-USaIQaopb-lPyPZcPKwEqzYwgyDHX_wyjURGrPQiP-9F--ux9TzRaEWNLNX685bKfMcvO-MhInhwO-VrRgwDTCKGsuVo780CCivNA1R39cgxxioBtV4 Jul 12 17:40:48.310038 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:40:48.310038 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:40:48.310038 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:40:48.310038 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:40:48.310038 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:40:48.310038 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:40:48.310038 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: 33a7a8fa558b472da92a52cdd63bdbad Jul 12 17:40:48.310038 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-DeleteServersTestJSON-1889107527 Jul 12 17:40:48.310038 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:40:48.310038 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:40:48.311805 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33a7a8fa558b472da92a52cdd63bdbad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_33a7a8fa558b472da92a52cdd63bdbad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33a7a8fa558b472da92a52cdd63bdbad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/33a7a8fa558b472da92a52cdd63bdbad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:40:48.311805 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-DeleteServersTestJSON-1889107527 Jul 12 17:40:48.311805 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: 33a7a8fa558b472da92a52cdd63bdbad Jul 12 17:40:48.311805 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-DeleteServersTestJSON-1889107527 Jul 12 17:40:48.311805 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-DeleteServersTestJSON-1889107527-project Jul 12 17:40:48.311805 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:40:48.311805 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:40:48.311805 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: cd79a28d8f774c1fac44185df36cd24f Jul 12 17:40:48.311805 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-DeleteServersTestJSON-1889107527-project Jul 12 17:40:48.311805 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: > Jul 12 17:40:48.311805 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Instance 407f15c2-26ad-460c-b4cd-281bc67c5c0d could not be found. Jul 12 17:40:48.311805 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'server_id': '407f15c2-26ad-460c-b4cd-281bc67c5c0d'} Jul 12 17:40:48.312760 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:40:48.312760 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:40:48.312760 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:40:48.312760 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:40:48.312760 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:40:48.312760 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:40:48.312760 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:40:48.312760 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:40:48.312760 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:40:48.312760 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:40:48.312760 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 407f15c2-26ad-460c-b4cd-281bc67c5c0d could not be found. Jul 12 17:40:48.312760 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:40:48.312760 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:40:48.312760 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:40:48.312760 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:40:48.312760 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:40:48.312760 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:40:48.312760 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:40:48.312760 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:40:48.312760 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:40:48.314329 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:40:48.314329 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 17:40:48.314329 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 17:40:48.314329 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 17:40:48.314329 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 17:40:48.314329 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 12 17:40:48.314329 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 12 17:40:48.314329 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:40:48.314329 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:40:48.314329 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 407f15c2-26ad-460c-b4cd-281bc67c5c0d could not be found. Jul 12 17:40:48.314329 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:40:48.314329 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:40:48.314329 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:40:48.314329 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:40:48.314329 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:40:48.314329 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:40:48.314329 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:40:48.314329 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:40:48.314329 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 407f15c2-26ad-460c-b4cd-281bc67c5c0d could not be found. Jul 12 17:40:48.314329 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:40:48.318714 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ec46aeeb-b4dc-4176-a96b-15b4bde5b3eb tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Returning 404 to user: Instance 407f15c2-26ad-460c-b4cd-281bc67c5c0d could not be found. {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:40:48.318714 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-ec46aeeb-b4dc-4176-a96b-15b4bde5b3eb tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042017 Jul 12 17:40:48.318714 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 125/228] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:40:48 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 17:40:48.360312 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-adaa4824-5622-4fe6-b707-13cfb199a0a1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:48.364545 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-adaa4824-5622-4fe6-b707-13cfb199a0a1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:48.383362 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-adaa4824-5622-4fe6-b707-13cfb199a0a1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:48.387800 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-adaa4824-5622-4fe6-b707-13cfb199a0a1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:48.387800 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-adaa4824-5622-4fe6-b707-13cfb199a0a1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:48.387800 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-adaa4824-5622-4fe6-b707-13cfb199a0a1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:48.426189 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-adaa4824-5622-4fe6-b707-13cfb199a0a1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:48.426867 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-adaa4824-5622-4fe6-b707-13cfb199a0a1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:48.427394 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.objects.instance [None req-adaa4824-5622-4fe6-b707-13cfb199a0a1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lazy-loading 'fault' on Instance uuid 9373a853-2fb9-427e-ba44-ec2825f27098 {{(pid=130058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:40:48.481624 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-adaa4824-5622-4fe6-b707-13cfb199a0a1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:48.496113 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-adaa4824-5622-4fe6-b707-13cfb199a0a1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 200 len: 1304 microversion: 2.1 time: 0.157052 Jul 12 17:40:48.506256 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 104/229] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:48 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 1304 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:48.644250 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-1a957e42-048d-4e2a-8255-d62043e202df tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:48.644918 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-1a957e42-048d-4e2a-8255-d62043e202df tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:48.651589 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1a957e42-048d-4e2a-8255-d62043e202df tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:48.652041 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1a957e42-048d-4e2a-8255-d62043e202df tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:48.658068 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1a957e42-048d-4e2a-8255-d62043e202df tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:48.658068 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1a957e42-048d-4e2a-8255-d62043e202df tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:48.936177 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-1a957e42-048d-4e2a-8255-d62043e202df tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:48.945290 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-1a957e42-048d-4e2a-8255-d62043e202df tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1501 microversion: 2.1 time: 0.305152 Jul 12 17:40:48.945972 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 126/230] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:48 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1501 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:48.969315 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-596d0a7a-5d8f-49fb-8819-74f62057fd18 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:48.969945 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-596d0a7a-5d8f-49fb-8819-74f62057fd18 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:48.976073 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-596d0a7a-5d8f-49fb-8819-74f62057fd18 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:48.976526 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-596d0a7a-5d8f-49fb-8819-74f62057fd18 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:48.977301 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-596d0a7a-5d8f-49fb-8819-74f62057fd18 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:48.977779 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-596d0a7a-5d8f-49fb-8819-74f62057fd18 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:49.112805 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-596d0a7a-5d8f-49fb-8819-74f62057fd18 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:49.120702 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-596d0a7a-5d8f-49fb-8819-74f62057fd18 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1516 microversion: 2.1 time: 0.156246 Jul 12 17:40:49.121308 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 105/231] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:48 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:49.513205 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-f4f0410b-79ae-4cf9-8e7d-fe89d9c8dd92 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:49.513906 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-f4f0410b-79ae-4cf9-8e7d-fe89d9c8dd92 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 9373a853-2fb9-427e-ba44-ec2825f27098] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:49.520436 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f4f0410b-79ae-4cf9-8e7d-fe89d9c8dd92 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:49.526919 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f4f0410b-79ae-4cf9-8e7d-fe89d9c8dd92 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:49.526919 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f4f0410b-79ae-4cf9-8e7d-fe89d9c8dd92 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:49.526919 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f4f0410b-79ae-4cf9-8e7d-fe89d9c8dd92 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:49.538673 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-f4f0410b-79ae-4cf9-8e7d-fe89d9c8dd92 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] HTTP exception thrown: Instance 9373a853-2fb9-427e-ba44-ec2825f27098 could not be found. Jul 12 17:40:49.540795 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-f4f0410b-79ae-4cf9-8e7d-fe89d9c8dd92 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Request method failure captured: Jul 12 17:40:49.540795 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 HTTP/1.1 Jul 12 17:40:49.540795 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:40:49.540795 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:40:49.540795 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:40:49.540795 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 0 Jul 12 17:40:49.540795 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:40:49.540795 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:40:49.540795 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:40:49.540795 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:40:49.540795 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbHn_IT6oK5btoBHCry6IGbBNCuKRjELGY0hEnIZctTya4SZCRwGaqOaq-4pNyPirHDto1C-OIpDVUyDuumC234Gyx_WlInOLoOgFFD4zIXTLzi_2BLMOt8hxs5A10MLolkK_sxQOoimVmU_S2k1dPqRZuqSQXLQ-p-KEXi1j_u6CtU Jul 12 17:40:49.540795 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:40:49.540795 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:40:49.540795 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:40:49.540795 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:40:49.540795 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:40:49.540795 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:40:49.540795 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: b3cb433fc8c44c87a642aaa9011ff624 Jul 12 17:40:49.540795 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-VolumesActionsTest-1922325739 Jul 12 17:40:49.540795 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:40:49.540795 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:40:49.542226 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3cb433fc8c44c87a642aaa9011ff624"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b3cb433fc8c44c87a642aaa9011ff624", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3cb433fc8c44c87a642aaa9011ff624"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b3cb433fc8c44c87a642aaa9011ff624"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:40:49.542226 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-VolumesActionsTest-1922325739 Jul 12 17:40:49.542226 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: b3cb433fc8c44c87a642aaa9011ff624 Jul 12 17:40:49.542226 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-VolumesActionsTest-1922325739 Jul 12 17:40:49.542226 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-VolumesActionsTest-1922325739-project Jul 12 17:40:49.542226 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:40:49.542226 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:40:49.542226 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: 2c4deca7942842759f795ab5299b44a3 Jul 12 17:40:49.542226 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-VolumesActionsTest-1922325739-project Jul 12 17:40:49.542226 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: > Jul 12 17:40:49.542226 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Instance 9373a853-2fb9-427e-ba44-ec2825f27098 could not be found. Jul 12 17:40:49.542226 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'id': '9373a853-2fb9-427e-ba44-ec2825f27098'} Jul 12 17:40:49.543228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:40:49.543228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:40:49.543228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:40:49.543228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:40:49.543228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:40:49.543228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:40:49.543228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:40:49.543228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:40:49.543228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:40:49.543228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:40:49.543228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9373a853-2fb9-427e-ba44-ec2825f27098 could not be found. Jul 12 17:40:49.543228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:40:49.543228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:40:49.543228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:40:49.543228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:40:49.543228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:40:49.543228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:40:49.543228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:40:49.543228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:40:49.543228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:40:49.545401 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:40:49.545401 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:40:49.545401 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:40:49.545401 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:40:49.545401 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:40:49.545401 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:40:49.545401 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:40:49.545401 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9373a853-2fb9-427e-ba44-ec2825f27098 could not be found. Jul 12 17:40:49.545401 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:40:49.545401 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:40:49.545401 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:40:49.545401 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:40:49.545401 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:40:49.545401 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:40:49.545401 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:40:49.545401 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:40:49.545401 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9373a853-2fb9-427e-ba44-ec2825f27098 could not be found. Jul 12 17:40:49.545401 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:40:49.546586 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-f4f0410b-79ae-4cf9-8e7d-fe89d9c8dd92 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Returning 404 to user: Instance 9373a853-2fb9-427e-ba44-ec2825f27098 could not be found. {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:40:49.546586 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-f4f0410b-79ae-4cf9-8e7d-fe89d9c8dd92 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098" status: 404 len: 111 microversion: 2.1 time: 0.032928 Jul 12 17:40:49.546586 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 127/232] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:49 2022] GET /compute/v2.1/servers/9373a853-2fb9-427e-ba44-ec2825f27098 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:40:49.679293 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-4b6f0032-6565-4bd2-93eb-5c5c8f8365d9 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1803391035", "imageRef": "cb077f42-97cd-41cf-8758-764c562534f4", "flavorRef": "452", "networks": [{"uuid": "fa38e137-0886-4f9b-8fe4-1e7fbf99c447"}]}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:40:49.753926 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.network.neutron [None req-4b6f0032-6565-4bd2-93eb-5c5c8f8365d9 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] validate_networks() for [('fa38e137-0886-4f9b-8fe4-1e7fbf99c447', None, None, None, None, None)] {{(pid=130058) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:40:50.187490 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-4b6f0032-6565-4bd2-93eb-5c5c8f8365d9 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Flavor limits 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:40:50.187970 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-4b6f0032-6565-4bd2-93eb-5c5c8f8365d9 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Image limits 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:40:50.188525 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-4b6f0032-6565-4bd2-93eb-5c5c8f8365d9 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Flavor pref 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:40:50.189252 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-4b6f0032-6565-4bd2-93eb-5c5c8f8365d9 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Image pref 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:40:50.189793 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-4b6f0032-6565-4bd2-93eb-5c5c8f8365d9 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:40:50.199563 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4b6f0032-6565-4bd2-93eb-5c5c8f8365d9 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:50.200016 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4b6f0032-6565-4bd2-93eb-5c5c8f8365d9 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:50.200835 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4b6f0032-6565-4bd2-93eb-5c5c8f8365d9 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:50.201353 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4b6f0032-6565-4bd2-93eb-5c5c8f8365d9 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:50.219910 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-4b6f0032-6565-4bd2-93eb-5c5c8f8365d9 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Getting quotas for project b3cb433fc8c44c87a642aaa9011ff624. Resources: {'cores', 'instances', 'ram'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:40:50.224462 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-4b6f0032-6565-4bd2-93eb-5c5c8f8365d9 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Getting quotas for user 2c4deca7942842759f795ab5299b44a3 and project b3cb433fc8c44c87a642aaa9011ff624. Resources: {'cores', 'instances', 'ram'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:40:50.236667 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-4b6f0032-6565-4bd2-93eb-5c5c8f8365d9 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Going to run 1 instances... {{(pid=130058) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:40:50.238980 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-4b6f0032-6565-4bd2-93eb-5c5c8f8365d9 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb077f42-97cd-41cf-8758-764c562534f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:40:50.392703 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-4b6f0032-6565-4bd2-93eb-5c5c8f8365d9 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.718621 Jul 12 17:40:50.393550 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 106/233] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 12 17:40:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:40:50.404518 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-66e1214d-0732-4b86-b3ab-ceed78f71787 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:50.405309 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-66e1214d-0732-4b86-b3ab-ceed78f71787 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:50.482567 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-66e1214d-0732-4b86-b3ab-ceed78f71787 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:50.489815 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-66e1214d-0732-4b86-b3ab-ceed78f71787 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e" status: 200 len: 1214 microversion: 2.1 time: 0.089757 Jul 12 17:40:50.490527 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 128/234] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:50 2022] GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:51.511130 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-d56fc7d3-90fc-4840-97e8-50ce64c4ca80 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:51.511668 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-d56fc7d3-90fc-4840-97e8-50ce64c4ca80 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:51.519122 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d56fc7d3-90fc-4840-97e8-50ce64c4ca80 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:51.519605 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d56fc7d3-90fc-4840-97e8-50ce64c4ca80 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:51.520455 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d56fc7d3-90fc-4840-97e8-50ce64c4ca80 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:51.520894 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d56fc7d3-90fc-4840-97e8-50ce64c4ca80 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:51.593019 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-d56fc7d3-90fc-4840-97e8-50ce64c4ca80 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:51.606128 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-d56fc7d3-90fc-4840-97e8-50ce64c4ca80 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e" status: 200 len: 1218 microversion: 2.1 time: 0.100300 Jul 12 17:40:51.608331 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 107/235] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:51 2022] GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:52.624171 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-f46dbab0-794e-44fd-a2b7-73edbcb455ca tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:52.627334 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-f46dbab0-794e-44fd-a2b7-73edbcb455ca tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:52.631402 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f46dbab0-794e-44fd-a2b7-73edbcb455ca tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:52.631857 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f46dbab0-794e-44fd-a2b7-73edbcb455ca tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:52.632639 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f46dbab0-794e-44fd-a2b7-73edbcb455ca tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:52.633075 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f46dbab0-794e-44fd-a2b7-73edbcb455ca tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:52.700258 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-f46dbab0-794e-44fd-a2b7-73edbcb455ca tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:52.709042 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-f46dbab0-794e-44fd-a2b7-73edbcb455ca tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e" status: 200 len: 1266 microversion: 2.1 time: 0.088511 Jul 12 17:40:52.709432 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 129/236] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:52 2022] GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:53.203223 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-2123c19c-1c90-42c9-a848-e64fee1a1a65 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:40:53.204798 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-2123c19c-1c90-42c9-a848-e64fee1a1a65 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:53.217959 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2123c19c-1c90-42c9-a848-e64fee1a1a65 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:53.224561 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2123c19c-1c90-42c9-a848-e64fee1a1a65 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:53.224561 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2123c19c-1c90-42c9-a848-e64fee1a1a65 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:53.224561 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2123c19c-1c90-42c9-a848-e64fee1a1a65 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:53.232755 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-7f614b27-3670-4bd9-bc1a-9162b877896e tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:53.234783 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-7f614b27-3670-4bd9-bc1a-9162b877896e tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:53.243598 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7f614b27-3670-4bd9-bc1a-9162b877896e tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:53.244310 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7f614b27-3670-4bd9-bc1a-9162b877896e tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:53.245375 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7f614b27-3670-4bd9-bc1a-9162b877896e tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:53.245987 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7f614b27-3670-4bd9-bc1a-9162b877896e tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:53.253665 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.objects.instance [None req-2123c19c-1c90-42c9-a848-e64fee1a1a65 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lazy-loading 'flavor' on Instance uuid 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a {{(pid=130058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:40:53.262915 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-7f614b27-3670-4bd9-bc1a-9162b877896e tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] HTTP exception thrown: Instance 407f15c2-26ad-460c-b4cd-281bc67c5c0d could not be found. Jul 12 17:40:53.266764 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-7f614b27-3670-4bd9-bc1a-9162b877896e tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Request method failure captured: Jul 12 17:40:53.266764 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: DELETE /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d HTTP/1.1 Jul 12 17:40:53.266764 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:40:53.266764 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:40:53.266764 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:40:53.266764 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 0 Jul 12 17:40:53.266764 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:40:53.266764 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:40:53.266764 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:40:53.266764 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:40:53.266764 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbHLhOaKy9VkLkNfmF4earV5EFkP0L_lDCJGIpxiXHuhPydTjHpekY8G1b5-USaIQaopb-lPyPZcPKwEqzYwgyDHX_wyjURGrPQiP-9F--ux9TzRaEWNLNX685bKfMcvO-MhInhwO-VrRgwDTCKGsuVo780CCivNA1R39cgxxioBtV4 Jul 12 17:40:53.266764 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:40:53.266764 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:40:53.266764 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:40:53.266764 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:40:53.266764 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:40:53.266764 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:40:53.266764 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: 33a7a8fa558b472da92a52cdd63bdbad Jul 12 17:40:53.266764 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-DeleteServersTestJSON-1889107527 Jul 12 17:40:53.266764 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:40:53.266764 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:40:53.268121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33a7a8fa558b472da92a52cdd63bdbad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_33a7a8fa558b472da92a52cdd63bdbad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33a7a8fa558b472da92a52cdd63bdbad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/33a7a8fa558b472da92a52cdd63bdbad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:40:53.268121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-DeleteServersTestJSON-1889107527 Jul 12 17:40:53.268121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: 33a7a8fa558b472da92a52cdd63bdbad Jul 12 17:40:53.268121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-DeleteServersTestJSON-1889107527 Jul 12 17:40:53.268121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-DeleteServersTestJSON-1889107527-project Jul 12 17:40:53.268121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:40:53.268121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:40:53.268121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: cd79a28d8f774c1fac44185df36cd24f Jul 12 17:40:53.268121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-DeleteServersTestJSON-1889107527-project Jul 12 17:40:53.268121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: > Jul 12 17:40:53.268121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Instance 407f15c2-26ad-460c-b4cd-281bc67c5c0d could not be found. Jul 12 17:40:53.268121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'id': '407f15c2-26ad-460c-b4cd-281bc67c5c0d'} Jul 12 17:40:53.268937 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:40:53.268937 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:40:53.268937 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:40:53.268937 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:40:53.268937 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:40:53.268937 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:40:53.268937 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:40:53.268937 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:40:53.268937 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:40:53.268937 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:40:53.268937 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 407f15c2-26ad-460c-b4cd-281bc67c5c0d could not be found. Jul 12 17:40:53.268937 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:40:53.268937 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:40:53.268937 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:40:53.268937 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:40:53.268937 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:40:53.268937 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:40:53.268937 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:40:53.268937 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:40:53.268937 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:40:53.270233 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:40:53.270233 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 17:40:53.270233 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 17:40:53.270233 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 17:40:53.270233 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 17:40:53.270233 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:40:53.270233 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:40:53.270233 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:40:53.270233 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:40:53.270233 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 407f15c2-26ad-460c-b4cd-281bc67c5c0d could not be found. Jul 12 17:40:53.270233 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:40:53.270233 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:40:53.270233 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:40:53.270233 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:40:53.270233 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:40:53.270233 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:40:53.270233 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:40:53.270233 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:40:53.270233 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 407f15c2-26ad-460c-b4cd-281bc67c5c0d could not be found. Jul 12 17:40:53.270233 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:40:53.273440 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-7f614b27-3670-4bd9-bc1a-9162b877896e tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Returning 404 to user: Instance 407f15c2-26ad-460c-b4cd-281bc67c5c0d could not be found. {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:40:53.274696 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-7f614b27-3670-4bd9-bc1a-9162b877896e tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "DELETE /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 404 len: 111 microversion: 2.1 time: 0.046160 Jul 12 17:40:53.281331 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 130/237] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 12 17:40:53 2022] DELETE /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:40:53.284745 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ac6b4f9e-c214-4900-ba37-9f340f745198 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:53.285420 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-ac6b4f9e-c214-4900-ba37-9f340f745198 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] [instance: 407f15c2-26ad-460c-b4cd-281bc67c5c0d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:53.292988 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ac6b4f9e-c214-4900-ba37-9f340f745198 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:53.294020 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ac6b4f9e-c214-4900-ba37-9f340f745198 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:53.295407 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ac6b4f9e-c214-4900-ba37-9f340f745198 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:53.296104 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ac6b4f9e-c214-4900-ba37-9f340f745198 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:53.329132 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-ac6b4f9e-c214-4900-ba37-9f340f745198 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] HTTP exception thrown: Instance 407f15c2-26ad-460c-b4cd-281bc67c5c0d could not be found. Jul 12 17:40:53.331121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ac6b4f9e-c214-4900-ba37-9f340f745198 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Request method failure captured: Jul 12 17:40:53.331121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d HTTP/1.1 Jul 12 17:40:53.331121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:40:53.331121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:40:53.331121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:40:53.331121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 0 Jul 12 17:40:53.331121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:40:53.331121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:40:53.331121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:40:53.331121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:40:53.331121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbHLhOaKy9VkLkNfmF4earV5EFkP0L_lDCJGIpxiXHuhPydTjHpekY8G1b5-USaIQaopb-lPyPZcPKwEqzYwgyDHX_wyjURGrPQiP-9F--ux9TzRaEWNLNX685bKfMcvO-MhInhwO-VrRgwDTCKGsuVo780CCivNA1R39cgxxioBtV4 Jul 12 17:40:53.331121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:40:53.331121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:40:53.331121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:40:53.331121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:40:53.331121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:40:53.331121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:40:53.331121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: 33a7a8fa558b472da92a52cdd63bdbad Jul 12 17:40:53.331121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-DeleteServersTestJSON-1889107527 Jul 12 17:40:53.331121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:40:53.331121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:40:53.332711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33a7a8fa558b472da92a52cdd63bdbad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_33a7a8fa558b472da92a52cdd63bdbad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33a7a8fa558b472da92a52cdd63bdbad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/33a7a8fa558b472da92a52cdd63bdbad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:40:53.332711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-DeleteServersTestJSON-1889107527 Jul 12 17:40:53.332711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: 33a7a8fa558b472da92a52cdd63bdbad Jul 12 17:40:53.332711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-DeleteServersTestJSON-1889107527 Jul 12 17:40:53.332711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-DeleteServersTestJSON-1889107527-project Jul 12 17:40:53.332711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:40:53.332711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:40:53.332711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: cd79a28d8f774c1fac44185df36cd24f Jul 12 17:40:53.332711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-DeleteServersTestJSON-1889107527-project Jul 12 17:40:53.332711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: > Jul 12 17:40:53.332711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Instance 407f15c2-26ad-460c-b4cd-281bc67c5c0d could not be found. Jul 12 17:40:53.332711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'id': '407f15c2-26ad-460c-b4cd-281bc67c5c0d'} Jul 12 17:40:53.333607 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:40:53.333607 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:40:53.333607 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:40:53.333607 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:40:53.333607 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:40:53.333607 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:40:53.333607 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:40:53.333607 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:40:53.333607 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:40:53.333607 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:40:53.333607 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 407f15c2-26ad-460c-b4cd-281bc67c5c0d could not be found. Jul 12 17:40:53.333607 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:40:53.333607 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:40:53.333607 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:40:53.333607 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:40:53.333607 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:40:53.333607 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:40:53.333607 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:40:53.333607 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:40:53.333607 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:40:53.334994 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:40:53.334994 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:40:53.334994 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:40:53.334994 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:40:53.334994 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:40:53.334994 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:40:53.334994 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:40:53.334994 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 407f15c2-26ad-460c-b4cd-281bc67c5c0d could not be found. Jul 12 17:40:53.334994 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:40:53.334994 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:40:53.334994 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:40:53.334994 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:40:53.334994 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:40:53.334994 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:40:53.334994 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:40:53.334994 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:40:53.334994 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 407f15c2-26ad-460c-b4cd-281bc67c5c0d could not be found. Jul 12 17:40:53.334994 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:40:53.337510 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ac6b4f9e-c214-4900-ba37-9f340f745198 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] Returning 404 to user: Instance 407f15c2-26ad-460c-b4cd-281bc67c5c0d could not be found. {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:40:53.339169 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-ac6b4f9e-c214-4900-ba37-9f340f745198 tempest-DeleteServersTestJSON-1889107527 tempest-DeleteServersTestJSON-1889107527-project] 10.222.0.16 "GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d" status: 404 len: 111 microversion: 2.1 time: 0.059222 Jul 12 17:40:53.340493 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 131/238] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:53 2022] GET /compute/v2.1/servers/407f15c2-26ad-460c-b4cd-281bc67c5c0d => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:40:53.368924 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=100 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:40:53.608016 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-2123c19c-1c90-42c9-a848-e64fee1a1a65 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "POST /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a/action" status: 200 len: 32 microversion: 2.1 time: 0.417031 Jul 12 17:40:53.609966 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 108/239] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jul 12 17:40:53 2022] POST /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a/action => generated 32 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 17:40:53.623715 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-3ee55547-9651-4a7c-aa7e-4ef0ac9aab9e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:53.625770 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-3ee55547-9651-4a7c-aa7e-4ef0ac9aab9e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:53.637565 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3ee55547-9651-4a7c-aa7e-4ef0ac9aab9e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:53.638324 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3ee55547-9651-4a7c-aa7e-4ef0ac9aab9e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:53.640359 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3ee55547-9651-4a7c-aa7e-4ef0ac9aab9e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:53.641194 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3ee55547-9651-4a7c-aa7e-4ef0ac9aab9e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:53.728459 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-efc550d0-c405-437a-ba2f-3a281c0bab35 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:53.729161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-efc550d0-c405-437a-ba2f-3a281c0bab35 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:53.738744 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-efc550d0-c405-437a-ba2f-3a281c0bab35 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:53.739397 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-efc550d0-c405-437a-ba2f-3a281c0bab35 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:53.741111 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-efc550d0-c405-437a-ba2f-3a281c0bab35 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:53.741551 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-efc550d0-c405-437a-ba2f-3a281c0bab35 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:53.837913 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-efc550d0-c405-437a-ba2f-3a281c0bab35 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:53.852653 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-efc550d0-c405-437a-ba2f-3a281c0bab35 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e" status: 200 len: 1272 microversion: 2.1 time: 0.128613 Jul 12 17:40:53.853864 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 109/240] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:53 2022] GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e => generated 1272 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:40:53.965833 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-3ee55547-9651-4a7c-aa7e-4ef0ac9aab9e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:53.976678 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-3ee55547-9651-4a7c-aa7e-4ef0ac9aab9e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1522 microversion: 2.1 time: 0.359533 Jul 12 17:40:53.977257 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 132/241] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:53 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:54.883412 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-38817419-f093-49c3-97f0-c16a0ffc9f70 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:54.884620 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-38817419-f093-49c3-97f0-c16a0ffc9f70 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:54.896470 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-38817419-f093-49c3-97f0-c16a0ffc9f70 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:54.897290 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-38817419-f093-49c3-97f0-c16a0ffc9f70 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:54.898569 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-38817419-f093-49c3-97f0-c16a0ffc9f70 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:54.899208 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-38817419-f093-49c3-97f0-c16a0ffc9f70 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:54.994026 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-492b5be3-c0b4-4060-a104-059fbf730445 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:54.994765 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-492b5be3-c0b4-4060-a104-059fbf730445 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:55.005870 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-492b5be3-c0b4-4060-a104-059fbf730445 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:55.006552 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-492b5be3-c0b4-4060-a104-059fbf730445 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:55.007533 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-492b5be3-c0b4-4060-a104-059fbf730445 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:55.008302 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-492b5be3-c0b4-4060-a104-059fbf730445 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:55.203106 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-38817419-f093-49c3-97f0-c16a0ffc9f70 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:55.229181 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-38817419-f093-49c3-97f0-c16a0ffc9f70 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e" status: 200 len: 1314 microversion: 2.1 time: 0.352603 Jul 12 17:40:55.230839 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 110/242] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:54 2022] GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:55.347689 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-492b5be3-c0b4-4060-a104-059fbf730445 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:55.355974 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-492b5be3-c0b4-4060-a104-059fbf730445 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1522 microversion: 2.1 time: 0.366200 Jul 12 17:40:55.356854 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 133/243] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:54 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:40:56.261660 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-50cd4dc6-e7ae-4f7e-ad03-d4d4d5f28204 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:56.266987 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-50cd4dc6-e7ae-4f7e-ad03-d4d4d5f28204 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:56.282254 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-50cd4dc6-e7ae-4f7e-ad03-d4d4d5f28204 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:56.283248 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-50cd4dc6-e7ae-4f7e-ad03-d4d4d5f28204 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:56.289220 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-50cd4dc6-e7ae-4f7e-ad03-d4d4d5f28204 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:56.290105 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-50cd4dc6-e7ae-4f7e-ad03-d4d4d5f28204 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:56.375732 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-20cea65e-aa70-4276-bff6-628541f4150f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:56.377104 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-20cea65e-aa70-4276-bff6-628541f4150f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:56.384072 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-20cea65e-aa70-4276-bff6-628541f4150f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:56.384517 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-20cea65e-aa70-4276-bff6-628541f4150f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:56.385529 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-20cea65e-aa70-4276-bff6-628541f4150f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:56.385986 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-20cea65e-aa70-4276-bff6-628541f4150f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:56.652662 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-20cea65e-aa70-4276-bff6-628541f4150f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:56.656829 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=100 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:40:56.662522 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-20cea65e-aa70-4276-bff6-628541f4150f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1522 microversion: 2.1 time: 0.290939 Jul 12 17:40:56.663246 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 134/244] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:56 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:57.224819 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-50cd4dc6-e7ae-4f7e-ad03-d4d4d5f28204 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:57.285310 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-50cd4dc6-e7ae-4f7e-ad03-d4d4d5f28204 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e" status: 200 len: 1314 microversion: 2.1 time: 1.039588 Jul 12 17:40:57.291831 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 111/245] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:56 2022] GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e => generated 1314 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:57.682870 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-6042f387-b0a0-4a85-9bf6-6cd56ceb6aa3 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:57.683824 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-6042f387-b0a0-4a85-9bf6-6cd56ceb6aa3 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:57.691566 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6042f387-b0a0-4a85-9bf6-6cd56ceb6aa3 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:57.692413 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6042f387-b0a0-4a85-9bf6-6cd56ceb6aa3 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:57.693647 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6042f387-b0a0-4a85-9bf6-6cd56ceb6aa3 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:57.694318 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6042f387-b0a0-4a85-9bf6-6cd56ceb6aa3 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:57.886625 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-6042f387-b0a0-4a85-9bf6-6cd56ceb6aa3 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:57.902376 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-6042f387-b0a0-4a85-9bf6-6cd56ceb6aa3 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1522 microversion: 2.1 time: 0.224929 Jul 12 17:40:57.903067 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 135/246] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:57 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:58.309414 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-4792a05a-ea47-42b6-a0c3-507b5b3fc20a tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:58.310033 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-4792a05a-ea47-42b6-a0c3-507b5b3fc20a tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:58.323260 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4792a05a-ea47-42b6-a0c3-507b5b3fc20a tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:58.326367 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4792a05a-ea47-42b6-a0c3-507b5b3fc20a tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:58.330049 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4792a05a-ea47-42b6-a0c3-507b5b3fc20a tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:58.330752 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4792a05a-ea47-42b6-a0c3-507b5b3fc20a tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:58.582949 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-bc5be123-0bb4-4962-ab00-284f9a62b0d0 req-a9e31f8b-3ab7-4328-b915-6a6987d65d98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e", "tag": "4b61bba7-ab2b-451f-b045-0e556aa23980"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:40:58.594329 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-4792a05a-ea47-42b6-a0c3-507b5b3fc20a tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:58.602793 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-bc5be123-0bb4-4962-ab00-284f9a62b0d0 req-a9e31f8b-3ab7-4328-b915-6a6987d65d98 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:58.606480 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-bc5be123-0bb4-4962-ab00-284f9a62b0d0 req-a9e31f8b-3ab7-4328-b915-6a6987d65d98 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:58.608326 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-4792a05a-ea47-42b6-a0c3-507b5b3fc20a tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e" status: 200 len: 1314 microversion: 2.1 time: 0.303263 Jul 12 17:40:58.610091 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 112/247] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:58 2022] GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:58.629738 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-bc5be123-0bb4-4962-ab00-284f9a62b0d0 req-a9e31f8b-3ab7-4328-b915-6a6987d65d98 service nova] Creating event network-changed:4b61bba7-ab2b-451f-b045-0e556aa23980 for instance 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e on hv-cinder-84875 Jul 12 17:40:58.635548 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-bc5be123-0bb4-4962-ab00-284f9a62b0d0 req-a9e31f8b-3ab7-4328-b915-6a6987d65d98 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074597 Jul 12 17:40:58.636368 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 136/248] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:40:58.936097 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-2acf65ea-c3b5-4afb-9bba-330488b943bc tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:58.936097 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-2acf65ea-c3b5-4afb-9bba-330488b943bc tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:58.936097 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2acf65ea-c3b5-4afb-9bba-330488b943bc tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:58.936097 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2acf65ea-c3b5-4afb-9bba-330488b943bc tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:58.937620 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2acf65ea-c3b5-4afb-9bba-330488b943bc tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:58.937620 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2acf65ea-c3b5-4afb-9bba-330488b943bc tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:59.277776 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-2acf65ea-c3b5-4afb-9bba-330488b943bc tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:59.297437 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-2acf65ea-c3b5-4afb-9bba-330488b943bc tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1522 microversion: 2.1 time: 0.380009 Jul 12 17:40:59.298797 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 113/249] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:58 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1522 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:59.627060 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-7a4e2ff6-5d9f-4a50-a709-8692e36d3de8 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:59.627862 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-7a4e2ff6-5d9f-4a50-a709-8692e36d3de8 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:59.634951 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7a4e2ff6-5d9f-4a50-a709-8692e36d3de8 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:59.635406 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7a4e2ff6-5d9f-4a50-a709-8692e36d3de8 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:59.636188 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7a4e2ff6-5d9f-4a50-a709-8692e36d3de8 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:59.636625 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7a4e2ff6-5d9f-4a50-a709-8692e36d3de8 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:59.815911 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-7a4e2ff6-5d9f-4a50-a709-8692e36d3de8 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:59.829083 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-7a4e2ff6-5d9f-4a50-a709-8692e36d3de8 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e" status: 200 len: 1314 microversion: 2.1 time: 0.203744 Jul 12 17:40:59.829083 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 137/250] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:59 2022] GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:41:00.315585 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-f61c9a8a-f212-4115-86a9-20879810c87e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:00.316396 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-f61c9a8a-f212-4115-86a9-20879810c87e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:00.319162 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell0:SELECT=2 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:41:00.320318 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell0:SELECT=6 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:41:00.326591 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f61c9a8a-f212-4115-86a9-20879810c87e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:00.326591 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f61c9a8a-f212-4115-86a9-20879810c87e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:00.326956 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f61c9a8a-f212-4115-86a9-20879810c87e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:00.327450 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f61c9a8a-f212-4115-86a9-20879810c87e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:00.491513 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-f61c9a8a-f212-4115-86a9-20879810c87e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:00.503481 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-f61c9a8a-f212-4115-86a9-20879810c87e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1522 microversion: 2.1 time: 0.192810 Jul 12 17:41:00.504213 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 114/251] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:00 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:00.853487 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-9754fef4-dc07-4c47-8743-edcfd1343ab2 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:00.859843 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-9754fef4-dc07-4c47-8743-edcfd1343ab2 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:00.862943 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell0:SELECT=2 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:41:00.878720 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9754fef4-dc07-4c47-8743-edcfd1343ab2 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:00.879092 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9754fef4-dc07-4c47-8743-edcfd1343ab2 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:00.879929 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9754fef4-dc07-4c47-8743-edcfd1343ab2 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:00.880964 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9754fef4-dc07-4c47-8743-edcfd1343ab2 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:01.107594 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-9754fef4-dc07-4c47-8743-edcfd1343ab2 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:01.116486 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-9754fef4-dc07-4c47-8743-edcfd1343ab2 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e" status: 200 len: 1314 microversion: 2.1 time: 0.275456 Jul 12 17:41:01.117074 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 138/252] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:00 2022] GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:01.521168 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-fe4e9a1e-5134-4270-bfd8-ebcd88015779 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:01.521791 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-fe4e9a1e-5134-4270-bfd8-ebcd88015779 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:01.528899 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fe4e9a1e-5134-4270-bfd8-ebcd88015779 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:01.529353 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fe4e9a1e-5134-4270-bfd8-ebcd88015779 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:01.530144 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fe4e9a1e-5134-4270-bfd8-ebcd88015779 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:01.530689 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fe4e9a1e-5134-4270-bfd8-ebcd88015779 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:01.752187 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-fe4e9a1e-5134-4270-bfd8-ebcd88015779 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:01.760930 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-fe4e9a1e-5134-4270-bfd8-ebcd88015779 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1522 microversion: 2.1 time: 0.243581 Jul 12 17:41:01.774612 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 115/253] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:01 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:02.134795 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-d4e275f7-350d-4839-9b72-b7d09dd551c1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:02.135411 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-d4e275f7-350d-4839-9b72-b7d09dd551c1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:02.142258 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d4e275f7-350d-4839-9b72-b7d09dd551c1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:02.142736 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d4e275f7-350d-4839-9b72-b7d09dd551c1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:02.143509 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d4e275f7-350d-4839-9b72-b7d09dd551c1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:02.144001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d4e275f7-350d-4839-9b72-b7d09dd551c1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:02.309282 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-d4e275f7-350d-4839-9b72-b7d09dd551c1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:02.318252 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-d4e275f7-350d-4839-9b72-b7d09dd551c1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e" status: 200 len: 1314 microversion: 2.1 time: 0.187788 Jul 12 17:41:02.319020 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 139/254] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:02 2022] GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:02.779834 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-1ad6c9f5-94b9-4f67-8053-26dde5c14b65 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:02.780440 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-1ad6c9f5-94b9-4f67-8053-26dde5c14b65 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:02.788764 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1ad6c9f5-94b9-4f67-8053-26dde5c14b65 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:02.789210 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1ad6c9f5-94b9-4f67-8053-26dde5c14b65 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:02.790035 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1ad6c9f5-94b9-4f67-8053-26dde5c14b65 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:02.790685 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1ad6c9f5-94b9-4f67-8053-26dde5c14b65 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:03.131765 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-1ad6c9f5-94b9-4f67-8053-26dde5c14b65 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:03.148892 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-1ad6c9f5-94b9-4f67-8053-26dde5c14b65 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1522 microversion: 2.1 time: 0.372208 Jul 12 17:41:03.162467 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 116/255] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:02 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:03.336282 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ec6e0635-7da5-45b7-aa8d-aaa01b2ce345 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:03.337001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-ec6e0635-7da5-45b7-aa8d-aaa01b2ce345 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:03.343667 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ec6e0635-7da5-45b7-aa8d-aaa01b2ce345 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:03.344145 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ec6e0635-7da5-45b7-aa8d-aaa01b2ce345 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:03.344925 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ec6e0635-7da5-45b7-aa8d-aaa01b2ce345 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:03.345367 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ec6e0635-7da5-45b7-aa8d-aaa01b2ce345 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:03.548183 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-ec6e0635-7da5-45b7-aa8d-aaa01b2ce345 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:03.594989 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-ec6e0635-7da5-45b7-aa8d-aaa01b2ce345 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e" status: 200 len: 1314 microversion: 2.1 time: 0.261098 Jul 12 17:41:03.596192 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 140/256] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:03 2022] GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:04.172807 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-11d3eb6b-80b0-4050-b042-bb354dc1e1ed tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:04.173431 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-11d3eb6b-80b0-4050-b042-bb354dc1e1ed tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:04.180484 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-11d3eb6b-80b0-4050-b042-bb354dc1e1ed tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:04.180882 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-11d3eb6b-80b0-4050-b042-bb354dc1e1ed tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:04.182038 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-11d3eb6b-80b0-4050-b042-bb354dc1e1ed tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:04.182675 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-11d3eb6b-80b0-4050-b042-bb354dc1e1ed tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:04.617180 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-65846105-d262-41f3-a93f-02fad74dc850 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:04.617180 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-65846105-d262-41f3-a93f-02fad74dc850 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:04.623899 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-65846105-d262-41f3-a93f-02fad74dc850 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:04.626473 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-65846105-d262-41f3-a93f-02fad74dc850 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:04.630511 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-65846105-d262-41f3-a93f-02fad74dc850 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:04.631423 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-65846105-d262-41f3-a93f-02fad74dc850 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:04.756483 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-11d3eb6b-80b0-4050-b042-bb354dc1e1ed tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:04.766535 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-11d3eb6b-80b0-4050-b042-bb354dc1e1ed tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1522 microversion: 2.1 time: 0.598473 Jul 12 17:41:04.767163 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 117/257] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:04 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1522 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:04.849835 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-65846105-d262-41f3-a93f-02fad74dc850 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:04.857743 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-65846105-d262-41f3-a93f-02fad74dc850 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e" status: 200 len: 1314 microversion: 2.1 time: 0.248477 Jul 12 17:41:04.868252 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 141/258] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:04 2022] GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:05.743945 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-7585e6e4-a7ad-429d-802a-8a4f96551aac tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:05.744829 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-7585e6e4-a7ad-429d-802a-8a4f96551aac tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:05.757438 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7585e6e4-a7ad-429d-802a-8a4f96551aac tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:05.758585 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7585e6e4-a7ad-429d-802a-8a4f96551aac tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:05.760319 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7585e6e4-a7ad-429d-802a-8a4f96551aac tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:05.761285 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7585e6e4-a7ad-429d-802a-8a4f96551aac tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:05.786591 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-99e69a91-e04e-4ea1-9329-293de6df2c78 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:05.788342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-99e69a91-e04e-4ea1-9329-293de6df2c78 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:05.795783 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-99e69a91-e04e-4ea1-9329-293de6df2c78 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:05.796285 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-99e69a91-e04e-4ea1-9329-293de6df2c78 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:05.797735 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-99e69a91-e04e-4ea1-9329-293de6df2c78 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:05.798533 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-99e69a91-e04e-4ea1-9329-293de6df2c78 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:05.808282 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-7585e6e4-a7ad-429d-802a-8a4f96551aac tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699/ips" status: 200 len: 152 microversion: 2.20 time: 0.072853 Jul 12 17:41:05.814796 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 118/259] 10.222.0.16 () {60 vars in 1288 bytes} [Tue Jul 12 17:41:05 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699/ips => generated 152 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:41:05.880424 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-02926ac2-ae0c-4975-b0c1-329275592ac5 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:05.884121 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-02926ac2-ae0c-4975-b0c1-329275592ac5 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:05.898491 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-02926ac2-ae0c-4975-b0c1-329275592ac5 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:05.899394 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-02926ac2-ae0c-4975-b0c1-329275592ac5 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:05.900512 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-02926ac2-ae0c-4975-b0c1-329275592ac5 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:05.901012 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-02926ac2-ae0c-4975-b0c1-329275592ac5 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:06.063497 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-99e69a91-e04e-4ea1-9329-293de6df2c78 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:06.072177 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-99e69a91-e04e-4ea1-9329-293de6df2c78 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1522 microversion: 2.1 time: 0.292223 Jul 12 17:41:06.082747 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 142/260] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:05 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:41:06.140893 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-02926ac2-ae0c-4975-b0c1-329275592ac5 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:06.148646 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-02926ac2-ae0c-4975-b0c1-329275592ac5 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e" status: 200 len: 1314 microversion: 2.1 time: 0.276258 Jul 12 17:41:06.149335 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 119/261] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:05 2022] GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:06.632211 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-d387443b-8099-4169-9c7f-cabd52cfe639 req-424cd594-7bb7-40fe-82f0-ba8a52736fe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e", "name": "network-vif-plugged", "status": "completed", "tag": "4b61bba7-ab2b-451f-b045-0e556aa23980"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:41:06.645823 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-d387443b-8099-4169-9c7f-cabd52cfe639 req-424cd594-7bb7-40fe-82f0-ba8a52736fe0 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:06.646883 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-d387443b-8099-4169-9c7f-cabd52cfe639 req-424cd594-7bb7-40fe-82f0-ba8a52736fe0 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:06.668029 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-d387443b-8099-4169-9c7f-cabd52cfe639 req-424cd594-7bb7-40fe-82f0-ba8a52736fe0 service nova] Creating event network-vif-plugged:4b61bba7-ab2b-451f-b045-0e556aa23980 for instance 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e on hv-cinder-84875 Jul 12 17:41:06.676861 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-d387443b-8099-4169-9c7f-cabd52cfe639 req-424cd594-7bb7-40fe-82f0-ba8a52736fe0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048799 Jul 12 17:41:06.679035 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 143/262] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:41:07.091524 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-263aa94f-83fe-410f-a9a1-934819af144a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:07.092437 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-263aa94f-83fe-410f-a9a1-934819af144a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:07.102160 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-263aa94f-83fe-410f-a9a1-934819af144a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:07.102715 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-263aa94f-83fe-410f-a9a1-934819af144a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:07.108688 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-263aa94f-83fe-410f-a9a1-934819af144a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:07.108688 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-263aa94f-83fe-410f-a9a1-934819af144a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:07.114290 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-1ccde837-0bb6-45f1-aebb-4f443d50fb3c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:07.116542 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-1ccde837-0bb6-45f1-aebb-4f443d50fb3c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:07.137977 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1ccde837-0bb6-45f1-aebb-4f443d50fb3c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:07.138775 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1ccde837-0bb6-45f1-aebb-4f443d50fb3c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:07.139857 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1ccde837-0bb6-45f1-aebb-4f443d50fb3c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:07.141008 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1ccde837-0bb6-45f1-aebb-4f443d50fb3c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:07.173633 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-1ccde837-0bb6-45f1-aebb-4f443d50fb3c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/ips" status: 200 len: 147 microversion: 2.1 time: 0.073102 Jul 12 17:41:07.181854 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 144/263] 10.222.0.16 () {58 vars in 1247 bytes} [Tue Jul 12 17:41:07 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/ips => generated 147 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:41:07.187082 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-f0b8369e-3dc8-4623-b334-7f2eeb02adf5 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:07.188405 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-f0b8369e-3dc8-4623-b334-7f2eeb02adf5 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:07.197257 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f0b8369e-3dc8-4623-b334-7f2eeb02adf5 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:07.197934 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f0b8369e-3dc8-4623-b334-7f2eeb02adf5 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:07.198927 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f0b8369e-3dc8-4623-b334-7f2eeb02adf5 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:07.199811 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f0b8369e-3dc8-4623-b334-7f2eeb02adf5 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:07.377843 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-f0b8369e-3dc8-4623-b334-7f2eeb02adf5 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:07.385517 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-f0b8369e-3dc8-4623-b334-7f2eeb02adf5 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e" status: 200 len: 1314 microversion: 2.1 time: 0.202447 Jul 12 17:41:07.386379 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 145/264] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:07 2022] GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:07.578416 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-263aa94f-83fe-410f-a9a1-934819af144a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:07.597425 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-263aa94f-83fe-410f-a9a1-934819af144a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1522 microversion: 2.1 time: 0.509929 Jul 12 17:41:07.600815 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 120/265] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:07 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1522 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:08.404221 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-1df7fcbd-a89d-4abe-848c-5a5bdacdaa7f tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:08.404904 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-1df7fcbd-a89d-4abe-848c-5a5bdacdaa7f tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:08.412159 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1df7fcbd-a89d-4abe-848c-5a5bdacdaa7f tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:08.412615 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1df7fcbd-a89d-4abe-848c-5a5bdacdaa7f tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:08.413603 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1df7fcbd-a89d-4abe-848c-5a5bdacdaa7f tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:08.414080 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1df7fcbd-a89d-4abe-848c-5a5bdacdaa7f tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:08.583723 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-1df7fcbd-a89d-4abe-848c-5a5bdacdaa7f tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:08.599874 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-1df7fcbd-a89d-4abe-848c-5a5bdacdaa7f tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e" status: 200 len: 1314 microversion: 2.1 time: 0.199704 Jul 12 17:41:08.600487 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 146/266] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:08 2022] GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:08.621170 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-0055a54c-891a-425a-bb64-affb537da501 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:08.622375 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-0055a54c-891a-425a-bb64-affb537da501 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:08.639044 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0055a54c-891a-425a-bb64-affb537da501 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:08.639744 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0055a54c-891a-425a-bb64-affb537da501 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:08.640597 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0055a54c-891a-425a-bb64-affb537da501 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:08.641107 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0055a54c-891a-425a-bb64-affb537da501 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:08.903536 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0055a54c-891a-425a-bb64-affb537da501 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:08.924822 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-0055a54c-891a-425a-bb64-affb537da501 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1522 microversion: 2.1 time: 0.311107 Jul 12 17:41:08.926930 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 121/267] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:08 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:09.636330 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-f7c40c20-1572-4dc1-9e9c-cce1891eaad1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:09.637464 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-f7c40c20-1572-4dc1-9e9c-cce1891eaad1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:09.658856 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:41:09.661722 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f7c40c20-1572-4dc1-9e9c-cce1891eaad1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:09.662554 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f7c40c20-1572-4dc1-9e9c-cce1891eaad1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:09.663837 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f7c40c20-1572-4dc1-9e9c-cce1891eaad1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:09.664634 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f7c40c20-1572-4dc1-9e9c-cce1891eaad1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:09.951059 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-d5e12c5f-0a87-4c68-9892-6700aa8cb15a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:09.952621 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-d5e12c5f-0a87-4c68-9892-6700aa8cb15a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:09.966349 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d5e12c5f-0a87-4c68-9892-6700aa8cb15a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:09.972249 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d5e12c5f-0a87-4c68-9892-6700aa8cb15a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:09.973432 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d5e12c5f-0a87-4c68-9892-6700aa8cb15a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:09.974371 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d5e12c5f-0a87-4c68-9892-6700aa8cb15a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:10.037758 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-f7c40c20-1572-4dc1-9e9c-cce1891eaad1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:10.055466 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-f7c40c20-1572-4dc1-9e9c-cce1891eaad1 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e" status: 200 len: 1496 microversion: 2.1 time: 0.434809 Jul 12 17:41:10.072884 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 147/268] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:09 2022] GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e => generated 1496 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:10.237434 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-d5e12c5f-0a87-4c68-9892-6700aa8cb15a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:10.247302 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-d5e12c5f-0a87-4c68-9892-6700aa8cb15a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1522 microversion: 2.1 time: 0.305318 Jul 12 17:41:10.247900 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 122/269] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:09 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:10.468025 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-f82bd655-d6c8-4db7-b258-f1828435cb13 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a75ab260-fa20-4bc4-ba8b-e43b3b07b894"}} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:41:10.470232 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-f82bd655-d6c8-4db7-b258-f1828435cb13 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:10.478393 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f82bd655-d6c8-4db7-b258-f1828435cb13 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:10.479159 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f82bd655-d6c8-4db7-b258-f1828435cb13 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:10.480316 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f82bd655-d6c8-4db7-b258-f1828435cb13 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:10.481030 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f82bd655-d6c8-4db7-b258-f1828435cb13 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:11.272191 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b134202b-03a6-46b0-9a66-c6935926d8b6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:11.273078 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-b134202b-03a6-46b0-9a66-c6935926d8b6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:11.280392 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b134202b-03a6-46b0-9a66-c6935926d8b6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:11.280868 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b134202b-03a6-46b0-9a66-c6935926d8b6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:11.286032 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b134202b-03a6-46b0-9a66-c6935926d8b6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:11.291132 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b134202b-03a6-46b0-9a66-c6935926d8b6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:11.557199 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-b134202b-03a6-46b0-9a66-c6935926d8b6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:11.576489 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-b134202b-03a6-46b0-9a66-c6935926d8b6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1522 microversion: 2.1 time: 0.308098 Jul 12 17:41:11.577379 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 123/270] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:11 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:12.599418 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-c6848aad-fcbd-45a2-bb52-df7b552fc1de tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:12.600029 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-c6848aad-fcbd-45a2-bb52-df7b552fc1de tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:12.611125 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c6848aad-fcbd-45a2-bb52-df7b552fc1de tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:12.611635 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c6848aad-fcbd-45a2-bb52-df7b552fc1de tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:12.613600 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c6848aad-fcbd-45a2-bb52-df7b552fc1de tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:12.613600 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c6848aad-fcbd-45a2-bb52-df7b552fc1de tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:12.639610 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:41:12.786772 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-c6848aad-fcbd-45a2-bb52-df7b552fc1de tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:12.794636 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-c6848aad-fcbd-45a2-bb52-df7b552fc1de tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1522 microversion: 2.1 time: 0.201663 Jul 12 17:41:12.795221 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 124/271] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:12 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:41:13.796194 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-a4281f9a-c6aa-4932-b059-2e97214be9d5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:41:13.798368 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-a4281f9a-c6aa-4932-b059-2e97214be9d5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:13.805643 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a4281f9a-c6aa-4932-b059-2e97214be9d5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:13.806466 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a4281f9a-c6aa-4932-b059-2e97214be9d5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:13.808101 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a4281f9a-c6aa-4932-b059-2e97214be9d5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:13.808774 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a4281f9a-c6aa-4932-b059-2e97214be9d5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:13.848232 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.objects.instance [None req-a4281f9a-c6aa-4932-b059-2e97214be9d5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lazy-loading 'flavor' on Instance uuid 7f88418d-5f96-4c05-adf4-09d83f045699 {{(pid=130058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:41:14.151920 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-f82bd655-d6c8-4db7-b258-f1828435cb13 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "POST /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.689120 Jul 12 17:41:14.153259 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 148/272] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jul 12 17:41:10 2022] POST /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments => generated 194 bytes in 3692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:41:14.159817 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-176a7c2d-2c09-4c2a-8c54-99eae8e3d8d5 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:14.161254 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-176a7c2d-2c09-4c2a-8c54-99eae8e3d8d5 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:14.170045 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-176a7c2d-2c09-4c2a-8c54-99eae8e3d8d5 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:14.170713 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-176a7c2d-2c09-4c2a-8c54-99eae8e3d8d5 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:14.171831 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-176a7c2d-2c09-4c2a-8c54-99eae8e3d8d5 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:14.172548 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-176a7c2d-2c09-4c2a-8c54-99eae8e3d8d5 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:14.508894 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-176a7c2d-2c09-4c2a-8c54-99eae8e3d8d5 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:14.552355 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-176a7c2d-2c09-4c2a-8c54-99eae8e3d8d5 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1522 microversion: 2.1 time: 0.397148 Jul 12 17:41:14.553494 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 149/273] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:14 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1522 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:14.560602 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-0337e711-bc70-44f9-978f-328d68703b03 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:14.561776 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-0337e711-bc70-44f9-978f-328d68703b03 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:14.571411 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0337e711-bc70-44f9-978f-328d68703b03 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:14.573304 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0337e711-bc70-44f9-978f-328d68703b03 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:14.574330 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0337e711-bc70-44f9-978f-328d68703b03 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:14.575011 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0337e711-bc70-44f9-978f-328d68703b03 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:14.650180 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-0337e711-bc70-44f9-978f-328d68703b03 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e] Going to try to terminate instance {{(pid=130059) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:41:14.742910 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:41:14.801921 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-a4281f9a-c6aa-4932-b059-2e97214be9d5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "POST /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699/action" status: 202 len: 0 microversion: 2.20 time: 1.016983 Jul 12 17:41:14.805866 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 125/274] 10.222.0.16 () {62 vars in 1318 bytes} [Tue Jul 12 17:41:13 2022] POST /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699/action => generated 0 bytes in 1019 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:41:14.813725 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-4a7f1bec-8dc6-4881-b0d7-c57f11c43a5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:14.814472 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-4a7f1bec-8dc6-4881-b0d7-c57f11c43a5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:14.832049 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4a7f1bec-8dc6-4881-b0d7-c57f11c43a5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:14.832499 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4a7f1bec-8dc6-4881-b0d7-c57f11c43a5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:14.837331 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4a7f1bec-8dc6-4881-b0d7-c57f11c43a5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:14.838074 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4a7f1bec-8dc6-4881-b0d7-c57f11c43a5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:15.057025 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-0337e711-bc70-44f9-978f-328d68703b03 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "DELETE /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e" status: 204 len: 0 microversion: 2.1 time: 0.500630 Jul 12 17:41:15.061270 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 150/275] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 12 17:41:14 2022] DELETE /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:41:15.070627 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-bc5dd290-18de-48c4-a3b3-d313e5c29329 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:15.074062 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-bc5dd290-18de-48c4-a3b3-d313e5c29329 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:15.079419 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bc5dd290-18de-48c4-a3b3-d313e5c29329 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:15.080170 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bc5dd290-18de-48c4-a3b3-d313e5c29329 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:15.081467 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bc5dd290-18de-48c4-a3b3-d313e5c29329 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:15.082105 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bc5dd290-18de-48c4-a3b3-d313e5c29329 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:15.101214 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-4a7f1bec-8dc6-4881-b0d7-c57f11c43a5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:15.112130 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-4a7f1bec-8dc6-4881-b0d7-c57f11c43a5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:15.114687 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-4a7f1bec-8dc6-4881-b0d7-c57f11c43a5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:15.116972 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-4a7f1bec-8dc6-4881-b0d7-c57f11c43a5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1721 microversion: 2.20 time: 0.308990 Jul 12 17:41:15.117841 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 126/276] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:41:14 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1721 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:41:15.348556 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-bc5dd290-18de-48c4-a3b3-d313e5c29329 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:15.357375 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-bc5dd290-18de-48c4-a3b3-d313e5c29329 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e" status: 200 len: 1502 microversion: 2.1 time: 0.291011 Jul 12 17:41:15.358499 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 151/277] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:15 2022] GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e => generated 1502 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:15.569743 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-6a399243-ce0d-4d3a-b9f9-107b2b2b2740 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:15.570350 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-6a399243-ce0d-4d3a-b9f9-107b2b2b2740 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:15.578757 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6a399243-ce0d-4d3a-b9f9-107b2b2b2740 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:15.579584 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6a399243-ce0d-4d3a-b9f9-107b2b2b2740 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:15.585187 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6a399243-ce0d-4d3a-b9f9-107b2b2b2740 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:15.585187 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6a399243-ce0d-4d3a-b9f9-107b2b2b2740 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:15.845203 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-6a399243-ce0d-4d3a-b9f9-107b2b2b2740 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:15.864609 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-6a399243-ce0d-4d3a-b9f9-107b2b2b2740 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1522 microversion: 2.1 time: 0.296782 Jul 12 17:41:15.878424 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 127/278] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:15 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:16.138627 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a80a19b2-0005-44d0-9ba1-0588bfde6827 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:16.139598 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-a80a19b2-0005-44d0-9ba1-0588bfde6827 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:16.149032 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a80a19b2-0005-44d0-9ba1-0588bfde6827 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:16.151604 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a80a19b2-0005-44d0-9ba1-0588bfde6827 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:16.151604 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a80a19b2-0005-44d0-9ba1-0588bfde6827 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:16.151604 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a80a19b2-0005-44d0-9ba1-0588bfde6827 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:16.385792 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-5c59f873-3830-4891-b777-7f6eccc8c959 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:16.386457 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-5c59f873-3830-4891-b777-7f6eccc8c959 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:16.389918 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:41:16.396194 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5c59f873-3830-4891-b777-7f6eccc8c959 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:16.398925 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5c59f873-3830-4891-b777-7f6eccc8c959 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:16.400096 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5c59f873-3830-4891-b777-7f6eccc8c959 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:16.404836 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5c59f873-3830-4891-b777-7f6eccc8c959 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:16.409571 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a80a19b2-0005-44d0-9ba1-0588bfde6827 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:16.429329 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a80a19b2-0005-44d0-9ba1-0588bfde6827 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:16.431472 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a80a19b2-0005-44d0-9ba1-0588bfde6827 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:16.434816 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-a80a19b2-0005-44d0-9ba1-0588bfde6827 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1721 microversion: 2.20 time: 0.300202 Jul 12 17:41:16.438471 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 152/279] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:41:16 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1721 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:41:16.680188 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-5c59f873-3830-4891-b777-7f6eccc8c959 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:16.690204 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-5c59f873-3830-4891-b777-7f6eccc8c959 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e" status: 200 len: 1502 microversion: 2.1 time: 0.308524 Jul 12 17:41:16.691187 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 128/280] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:16 2022] GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e => generated 1502 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:41:16.885589 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-40657ee2-f17f-43ce-a40a-a4c66d5f443c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:16.886350 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-40657ee2-f17f-43ce-a40a-a4c66d5f443c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:16.945062 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-40657ee2-f17f-43ce-a40a-a4c66d5f443c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:16.946164 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-40657ee2-f17f-43ce-a40a-a4c66d5f443c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:16.947849 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-40657ee2-f17f-43ce-a40a-a4c66d5f443c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:16.948822 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-40657ee2-f17f-43ce-a40a-a4c66d5f443c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:17.285541 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-40657ee2-f17f-43ce-a40a-a4c66d5f443c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:17.300137 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-40657ee2-f17f-43ce-a40a-a4c66d5f443c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1522 microversion: 2.1 time: 0.417679 Jul 12 17:41:17.300137 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 153/281] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:16 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:41:17.463487 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-7cba12c3-082d-4059-b373-dbdf25445d10 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:17.464327 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-7cba12c3-082d-4059-b373-dbdf25445d10 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:17.483274 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7cba12c3-082d-4059-b373-dbdf25445d10 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:17.485609 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7cba12c3-082d-4059-b373-dbdf25445d10 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:17.496225 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7cba12c3-082d-4059-b373-dbdf25445d10 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:17.504809 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7cba12c3-082d-4059-b373-dbdf25445d10 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:17.717116 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-f2b0cec9-ed26-4964-a8ea-72c4118e4a48 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:17.717116 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-f2b0cec9-ed26-4964-a8ea-72c4118e4a48 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:17.725830 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f2b0cec9-ed26-4964-a8ea-72c4118e4a48 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:17.726297 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f2b0cec9-ed26-4964-a8ea-72c4118e4a48 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:17.727160 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f2b0cec9-ed26-4964-a8ea-72c4118e4a48 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:17.727608 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f2b0cec9-ed26-4964-a8ea-72c4118e4a48 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:17.841458 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-7cba12c3-082d-4059-b373-dbdf25445d10 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:17.853827 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-7cba12c3-082d-4059-b373-dbdf25445d10 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:17.855994 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-7cba12c3-082d-4059-b373-dbdf25445d10 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:17.857492 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-7cba12c3-082d-4059-b373-dbdf25445d10 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1721 microversion: 2.20 time: 0.401159 Jul 12 17:41:17.858642 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 129/282] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:41:17 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1721 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:41:18.022042 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-f2b0cec9-ed26-4964-a8ea-72c4118e4a48 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:18.034113 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-f2b0cec9-ed26-4964-a8ea-72c4118e4a48 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e" status: 200 len: 1502 microversion: 2.1 time: 0.325096 Jul 12 17:41:18.035420 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 154/283] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:17 2022] GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e => generated 1502 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:18.318034 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-2cbaff94-65e3-4064-b7a8-4200d1cd83da tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:18.319254 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-2cbaff94-65e3-4064-b7a8-4200d1cd83da tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:18.338918 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2cbaff94-65e3-4064-b7a8-4200d1cd83da tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:18.339635 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2cbaff94-65e3-4064-b7a8-4200d1cd83da tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:18.345027 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2cbaff94-65e3-4064-b7a8-4200d1cd83da tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:18.345624 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2cbaff94-65e3-4064-b7a8-4200d1cd83da tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:18.686787 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-983d285c-ef83-44dd-81b7-80e544d777d1 req-6fca8f94-61a3-423c-91f6-821ded3ec712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e", "name": "network-vif-deleted", "tag": "4b61bba7-ab2b-451f-b045-0e556aa23980"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:41:18.703893 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-983d285c-ef83-44dd-81b7-80e544d777d1 req-6fca8f94-61a3-423c-91f6-821ded3ec712 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:18.704346 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-983d285c-ef83-44dd-81b7-80e544d777d1 req-6fca8f94-61a3-423c-91f6-821ded3ec712 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:18.743697 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-983d285c-ef83-44dd-81b7-80e544d777d1 req-6fca8f94-61a3-423c-91f6-821ded3ec712 service nova] Creating event network-vif-deleted:4b61bba7-ab2b-451f-b045-0e556aa23980 for instance 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e on hv-cinder-84875 Jul 12 17:41:18.756464 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-983d285c-ef83-44dd-81b7-80e544d777d1 req-6fca8f94-61a3-423c-91f6-821ded3ec712 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074493 Jul 12 17:41:18.757467 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 155/284] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:41:18.782122 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-2cbaff94-65e3-4064-b7a8-4200d1cd83da tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:18.801225 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-2cbaff94-65e3-4064-b7a8-4200d1cd83da tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1522 microversion: 2.1 time: 0.482091 Jul 12 17:41:18.802241 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 130/285] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:18 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1522 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:18.884420 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-cbd57912-34a8-4ee0-b8a4-f0e189ee7858 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:18.885294 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-cbd57912-34a8-4ee0-b8a4-f0e189ee7858 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:18.902826 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cbd57912-34a8-4ee0-b8a4-f0e189ee7858 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:18.903492 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cbd57912-34a8-4ee0-b8a4-f0e189ee7858 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:18.904446 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cbd57912-34a8-4ee0-b8a4-f0e189ee7858 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:18.905662 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cbd57912-34a8-4ee0-b8a4-f0e189ee7858 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:19.052788 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-eb5b1856-d5b6-47d1-956b-7beeb73fa425 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:19.053557 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-eb5b1856-d5b6-47d1-956b-7beeb73fa425 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:19.066492 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-eb5b1856-d5b6-47d1-956b-7beeb73fa425 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:19.067089 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-eb5b1856-d5b6-47d1-956b-7beeb73fa425 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:19.067987 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-eb5b1856-d5b6-47d1-956b-7beeb73fa425 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:19.071743 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-eb5b1856-d5b6-47d1-956b-7beeb73fa425 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:19.157717 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-eb5b1856-d5b6-47d1-956b-7beeb73fa425 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:19.168112 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-eb5b1856-d5b6-47d1-956b-7beeb73fa425 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e" status: 200 len: 1299 microversion: 2.1 time: 0.119223 Jul 12 17:41:19.169996 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 131/286] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:19 2022] GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e => generated 1299 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:19.309139 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-cbd57912-34a8-4ee0-b8a4-f0e189ee7858 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:19.319269 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-cbd57912-34a8-4ee0-b8a4-f0e189ee7858 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:19.320878 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-cbd57912-34a8-4ee0-b8a4-f0e189ee7858 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:19.322145 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-cbd57912-34a8-4ee0-b8a4-f0e189ee7858 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1721 microversion: 2.20 time: 0.442558 Jul 12 17:41:19.322739 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 156/287] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:41:18 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1721 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:41:19.822269 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-468295ca-f06d-485e-9f84-abe649858db6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:19.823075 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-468295ca-f06d-485e-9f84-abe649858db6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:19.831157 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-468295ca-f06d-485e-9f84-abe649858db6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:19.831748 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-468295ca-f06d-485e-9f84-abe649858db6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:19.832671 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-468295ca-f06d-485e-9f84-abe649858db6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:19.833403 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-468295ca-f06d-485e-9f84-abe649858db6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:20.000599 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-468295ca-f06d-485e-9f84-abe649858db6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:20.014030 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-468295ca-f06d-485e-9f84-abe649858db6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1522 microversion: 2.1 time: 0.197083 Jul 12 17:41:20.015101 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 132/288] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:19 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:20.187458 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-3bb42bf7-19dd-4ef1-ba6c-30d72edbbac6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:20.188843 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-3bb42bf7-19dd-4ef1-ba6c-30d72edbbac6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:20.198139 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3bb42bf7-19dd-4ef1-ba6c-30d72edbbac6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:20.199041 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3bb42bf7-19dd-4ef1-ba6c-30d72edbbac6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:20.200091 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3bb42bf7-19dd-4ef1-ba6c-30d72edbbac6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:20.200744 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3bb42bf7-19dd-4ef1-ba6c-30d72edbbac6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:20.252062 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3bb42bf7-19dd-4ef1-ba6c-30d72edbbac6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:20.253208 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3bb42bf7-19dd-4ef1-ba6c-30d72edbbac6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:20.257592 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.objects.instance [None req-3bb42bf7-19dd-4ef1-ba6c-30d72edbbac6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lazy-loading 'fault' on Instance uuid 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e {{(pid=130059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:41:20.331447 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-3bb42bf7-19dd-4ef1-ba6c-30d72edbbac6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4deca7942842759f795ab5299b44a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3cb433fc8c44c87a642aaa9011ff624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:20.348595 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-e3955836-cba0-4e9c-b637-7f2010f24fbb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:20.348781 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-e3955836-cba0-4e9c-b637-7f2010f24fbb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:20.355039 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-3bb42bf7-19dd-4ef1-ba6c-30d72edbbac6 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e" status: 200 len: 1304 microversion: 2.1 time: 0.172168 Jul 12 17:41:20.356257 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 157/289] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:20 2022] GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e => generated 1304 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:20.364632 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e3955836-cba0-4e9c-b637-7f2010f24fbb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:20.365341 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e3955836-cba0-4e9c-b637-7f2010f24fbb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:20.369155 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e3955836-cba0-4e9c-b637-7f2010f24fbb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:20.371975 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e3955836-cba0-4e9c-b637-7f2010f24fbb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:20.555042 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-e3955836-cba0-4e9c-b637-7f2010f24fbb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:20.590172 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-e3955836-cba0-4e9c-b637-7f2010f24fbb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:20.601007 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-e3955836-cba0-4e9c-b637-7f2010f24fbb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:20.606595 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-e3955836-cba0-4e9c-b637-7f2010f24fbb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1721 microversion: 2.20 time: 0.265348 Jul 12 17:41:20.621754 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 133/290] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:41:20 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1721 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:41:21.036926 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-d89de39f-f754-4826-9ae1-01430141962d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:21.038676 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-d89de39f-f754-4826-9ae1-01430141962d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:21.050384 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d89de39f-f754-4826-9ae1-01430141962d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:21.051145 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d89de39f-f754-4826-9ae1-01430141962d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:21.052897 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d89de39f-f754-4826-9ae1-01430141962d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:21.054110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d89de39f-f754-4826-9ae1-01430141962d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:21.296191 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-d89de39f-f754-4826-9ae1-01430141962d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:21.308609 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-d89de39f-f754-4826-9ae1-01430141962d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1522 microversion: 2.1 time: 0.279365 Jul 12 17:41:21.309830 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 158/291] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:21 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:21.373432 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-6592d85a-f86b-463c-b17b-247096b2e6e7 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:21.374061 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-6592d85a-f86b-463c-b17b-247096b2e6e7 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] [instance: 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:21.384513 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6592d85a-f86b-463c-b17b-247096b2e6e7 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:21.385198 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6592d85a-f86b-463c-b17b-247096b2e6e7 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:21.386189 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6592d85a-f86b-463c-b17b-247096b2e6e7 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:21.386836 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6592d85a-f86b-463c-b17b-247096b2e6e7 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:21.408270 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.wsgi [None req-6592d85a-f86b-463c-b17b-247096b2e6e7 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] HTTP exception thrown: Instance 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e could not be found. Jul 12 17:41:21.410763 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-6592d85a-f86b-463c-b17b-247096b2e6e7 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Request method failure captured: Jul 12 17:41:21.410763 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: request: GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e HTTP/1.1 Jul 12 17:41:21.410763 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept: application/json Jul 12 17:41:21.410763 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept-Encoding: identity Jul 12 17:41:21.410763 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Connection: close Jul 12 17:41:21.410763 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Length: 0 Jul 12 17:41:21.410763 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Type: application/json Jul 12 17:41:21.410763 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Host: 10.222.0.16 Jul 12 17:41:21.410763 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Openstack-System-Scope: None Jul 12 17:41:21.410763 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: User-Agent: python-urllib3/1.26.9 Jul 12 17:41:21.410763 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Auth-Token: gAAAAABizbHn_IT6oK5btoBHCry6IGbBNCuKRjELGY0hEnIZctTya4SZCRwGaqOaq-4pNyPirHDto1C-OIpDVUyDuumC234Gyx_WlInOLoOgFFD4zIXTLzi_2BLMOt8hxs5A10MLolkK_sxQOoimVmU_S2k1dPqRZuqSQXLQ-p-KEXi1j_u6CtU Jul 12 17:41:21.410763 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Id: None Jul 12 17:41:21.410763 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Name: None Jul 12 17:41:21.410763 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Identity-Status: Confirmed Jul 12 17:41:21.410763 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Is-Admin-Project: True Jul 12 17:41:21.410763 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Id: default Jul 12 17:41:21.410763 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Name: Default Jul 12 17:41:21.410763 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Id: b3cb433fc8c44c87a642aaa9011ff624 Jul 12 17:41:21.410763 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Name: tempest-VolumesActionsTest-1922325739 Jul 12 17:41:21.410763 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Role: reader,member Jul 12 17:41:21.410763 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Roles: reader,member Jul 12 17:41:21.412293 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3cb433fc8c44c87a642aaa9011ff624"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b3cb433fc8c44c87a642aaa9011ff624", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3cb433fc8c44c87a642aaa9011ff624"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b3cb433fc8c44c87a642aaa9011ff624"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:41:21.412293 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant: tempest-VolumesActionsTest-1922325739 Jul 12 17:41:21.412293 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Id: b3cb433fc8c44c87a642aaa9011ff624 Jul 12 17:41:21.412293 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Name: tempest-VolumesActionsTest-1922325739 Jul 12 17:41:21.412293 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User: tempest-VolumesActionsTest-1922325739-project Jul 12 17:41:21.412293 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Id: default Jul 12 17:41:21.412293 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Name: Default Jul 12 17:41:21.412293 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Id: 2c4deca7942842759f795ab5299b44a3 Jul 12 17:41:21.412293 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Name: tempest-VolumesActionsTest-1922325739-project Jul 12 17:41:21.412293 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: method: > Jul 12 17:41:21.412293 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: exception: Instance 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e could not be found. Jul 12 17:41:21.412293 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: action_args: {'id': '70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e'} Jul 12 17:41:21.413226 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:41:21.413226 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:41:21.413226 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:41:21.413226 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:41:21.413226 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:41:21.413226 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:41:21.413226 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:41:21.413226 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:41:21.413226 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:41:21.413226 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:41:21.413226 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e could not be found. Jul 12 17:41:21.413226 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:41:21.413226 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:41:21.413226 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:41:21.413226 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:41:21.413226 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:41:21.413226 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:41:21.413226 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:41:21.413226 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:41:21.413226 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:41:21.421218 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:41:21.421218 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:41:21.421218 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:41:21.421218 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:41:21.421218 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:41:21.421218 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:41:21.421218 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:41:21.421218 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e could not be found. Jul 12 17:41:21.421218 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:41:21.421218 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:41:21.421218 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:41:21.421218 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:41:21.421218 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:41:21.421218 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:41:21.421218 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:41:21.421218 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:41:21.421218 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e could not be found. Jul 12 17:41:21.421218 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:41:21.422886 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-6592d85a-f86b-463c-b17b-247096b2e6e7 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] Returning 404 to user: Instance 70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e could not be found. {{(pid=130058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:41:21.422886 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-6592d85a-f86b-463c-b17b-247096b2e6e7 tempest-VolumesActionsTest-1922325739 tempest-VolumesActionsTest-1922325739-project] 10.222.0.16 "GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e" status: 404 len: 111 microversion: 2.1 time: 0.047989 Jul 12 17:41:21.422886 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 134/292] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:21 2022] GET /compute/v2.1/servers/70f66d8c-d9b6-4ea8-bd59-6c4b1c01c68e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:41:21.641448 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-be2300eb-e762-4af9-b48c-2872db028cac tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:21.642838 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-be2300eb-e762-4af9-b48c-2872db028cac tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:21.662143 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-be2300eb-e762-4af9-b48c-2872db028cac tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:21.662143 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-be2300eb-e762-4af9-b48c-2872db028cac tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:21.662143 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-be2300eb-e762-4af9-b48c-2872db028cac tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:21.662630 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-be2300eb-e762-4af9-b48c-2872db028cac tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:22.201861 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-be2300eb-e762-4af9-b48c-2872db028cac tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:22.215242 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-be2300eb-e762-4af9-b48c-2872db028cac tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:22.217197 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-be2300eb-e762-4af9-b48c-2872db028cac tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:22.219044 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-be2300eb-e762-4af9-b48c-2872db028cac tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1721 microversion: 2.20 time: 0.584558 Jul 12 17:41:22.219644 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 159/293] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:41:21 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1721 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:41:22.332556 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-e40c0f4e-98db-4567-b01e-53bb0172e9b9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:22.333672 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-e40c0f4e-98db-4567-b01e-53bb0172e9b9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:22.352748 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e40c0f4e-98db-4567-b01e-53bb0172e9b9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:22.354513 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e40c0f4e-98db-4567-b01e-53bb0172e9b9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:22.355868 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e40c0f4e-98db-4567-b01e-53bb0172e9b9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:22.357168 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e40c0f4e-98db-4567-b01e-53bb0172e9b9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:22.772369 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-e40c0f4e-98db-4567-b01e-53bb0172e9b9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:22.783429 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-e40c0f4e-98db-4567-b01e-53bb0172e9b9 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1502 microversion: 2.1 time: 0.457601 Jul 12 17:41:22.798007 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 135/294] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:22 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1502 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:22.805313 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ed12b4a5-dd86-4934-8053-71ece7a31c04 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fdb89228-3cd5-4b89-a625-0f4efb83536a"}} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:41:22.807279 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-ed12b4a5-dd86-4934-8053-71ece7a31c04 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:22.818270 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ed12b4a5-dd86-4934-8053-71ece7a31c04 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:22.819639 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ed12b4a5-dd86-4934-8053-71ece7a31c04 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:22.821167 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ed12b4a5-dd86-4934-8053-71ece7a31c04 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:22.822022 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ed12b4a5-dd86-4934-8053-71ece7a31c04 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:22.889465 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-ed12b4a5-dd86-4934-8053-71ece7a31c04 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] HTTP exception thrown: Cannot 'attach_volume' instance 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a while it is in vm_state rescued Jul 12 17:41:22.894359 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ed12b4a5-dd86-4934-8053-71ece7a31c04 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Request method failure captured: Jul 12 17:41:22.894359 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: POST /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a/os-volume_attachments HTTP/1.1 Jul 12 17:41:22.894359 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:41:22.894359 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:41:22.894359 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:41:22.894359 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 74 Jul 12 17:41:22.894359 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:41:22.894359 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:41:22.894359 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:41:22.894359 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:41:22.894359 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbHBn2P0AAPTeyjvRqGGm6Weg8HxPH-97n_6a8wVovT5QO-_rMGfsCxsgiu9EaBIW-KFncOPHrJH7Qnqsze2YkwIJvtmH_T_TgjuioF1uYFHDL21pP5xK7Y-mYfYQH4WSfEr_stqyIxKbKplZI_fQ0LBE7l4xFC8cVH7u9H_iS3Qd18 Jul 12 17:41:22.894359 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:41:22.894359 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:41:22.894359 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:41:22.894359 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:41:22.894359 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:41:22.894359 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:41:22.894359 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: 497c73f9a78743e9b24b2b6ff47d7ede Jul 12 17:41:22.894359 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-151557955 Jul 12 17:41:22.894359 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:41:22.894359 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:41:22.895979 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/497c73f9a78743e9b24b2b6ff47d7ede"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_497c73f9a78743e9b24b2b6ff47d7ede", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/497c73f9a78743e9b24b2b6ff47d7ede"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/497c73f9a78743e9b24b2b6ff47d7ede"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:41:22.895979 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-ServerRescueNegativeTestJSON-151557955 Jul 12 17:41:22.895979 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: 497c73f9a78743e9b24b2b6ff47d7ede Jul 12 17:41:22.895979 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-151557955 Jul 12 17:41:22.895979 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-ServerRescueNegativeTestJSON-151557955-project Jul 12 17:41:22.895979 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:41:22.895979 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:41:22.895979 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: ce09df98c929416e8ca67b0728349bfb Jul 12 17:41:22.895979 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-ServerRescueNegativeTestJSON-151557955-project Jul 12 17:41:22.895979 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Jul 12 17:41:22.895979 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {"volumeAttachment": {"volumeId": "fdb89228-3cd5-4b89-a625-0f4efb83536a"}} Jul 12 17:41:22.895979 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: > Jul 12 17:41:22.896829 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Cannot 'attach_volume' instance 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a while it is in vm_state rescued Jul 12 17:41:22.896829 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'server_id': '0c50a610-ffbb-40cc-b1d3-b05a598c7e3a', 'body': {'volumeAttachment': {'volumeId': 'fdb89228-3cd5-4b89-a625-0f4efb83536a'}}} Jul 12 17:41:22.896829 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:41:22.896829 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:41:22.896829 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 17:41:22.896829 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 17:41:22.896829 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 17:41:22.896829 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 17:41:22.896829 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 12 17:41:22.896829 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 12 17:41:22.896829 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 12 17:41:22.896829 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:41:22.896829 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:41:22.896829 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:41:22.896829 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:41:22.896829 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:41:22.896829 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:41:22.896829 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:41:22.896829 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:41:22.898165 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:41:22.898165 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:41:22.898165 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 17:41:22.898165 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 17:41:22.898165 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 17:41:22.898165 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 17:41:22.898165 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 17:41:22.898165 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 17:41:22.898165 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 12 17:41:22.898165 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 12 17:41:22.898165 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 12 17:41:22.898165 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 12 17:41:22.898165 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a while it is in vm_state rescued Jul 12 17:41:22.898165 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:41:22.898165 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:41:22.898165 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:41:22.898165 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:41:22.898165 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:41:22.898165 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:41:22.899637 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:41:22.899637 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:41:22.899637 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a while it is in vm_state rescued Jul 12 17:41:22.899637 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:41:22.903786 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ed12b4a5-dd86-4934-8053-71ece7a31c04 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Returning 409 to user: Cannot 'attach_volume' instance 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a while it is in vm_state rescued {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:41:22.905762 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-ed12b4a5-dd86-4934-8053-71ece7a31c04 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "POST /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.105386 Jul 12 17:41:22.907503 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 160/295] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jul 12 17:41:22 2022] POST /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a/os-volume_attachments => generated 152 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 12 17:41:22.916832 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-d5d0f291-0d62-4140-b168-74d5f09a479d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:41:22.917582 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-d5d0f291-0d62-4140-b168-74d5f09a479d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:22.930830 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d5d0f291-0d62-4140-b168-74d5f09a479d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:22.933373 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d5d0f291-0d62-4140-b168-74d5f09a479d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:22.934411 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d5d0f291-0d62-4140-b168-74d5f09a479d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:22.934997 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d5d0f291-0d62-4140-b168-74d5f09a479d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:23.307096 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-d5d0f291-0d62-4140-b168-74d5f09a479d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "POST /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a/action" status: 202 len: 0 microversion: 2.1 time: 0.394178 Jul 12 17:41:23.307772 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 136/296] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jul 12 17:41:22 2022] POST /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 17:41:23.340983 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-fc716f7b-d94f-4cad-9926-ef12b4e9a5c3 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:23.347179 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-fc716f7b-d94f-4cad-9926-ef12b4e9a5c3 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:23.359554 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-00a1ceec-0219-4c13-b6a0-981bc9117cf4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Action: 'create', calling method: .version_select at 0x7f479fe6d040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1463826168", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPugFfJwZE+9SL0gfpaUayvcyJTJwJGvJ0M3rjM3WrpIqUp31jF1LNeYJ05+O19Tf+sBJVNeD3dK9WVF3nI77e8CceS/496kb6alltfoPj5iY9s2kY7zuABWMKN/ibHrPQ=="}} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:41:23.369077 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fc716f7b-d94f-4cad-9926-ef12b4e9a5c3 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:23.369523 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fc716f7b-d94f-4cad-9926-ef12b4e9a5c3 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:23.375636 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fc716f7b-d94f-4cad-9926-ef12b4e9a5c3 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:23.376806 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fc716f7b-d94f-4cad-9926-ef12b4e9a5c3 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:23.411787 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.quota [None req-00a1ceec-0219-4c13-b6a0-981bc9117cf4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Getting quotas for project e4b2b488b746454b9f93d67fa3c97809. Resources: {'key_pairs'} {{(pid=130059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:41:23.421309 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.quota [None req-00a1ceec-0219-4c13-b6a0-981bc9117cf4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Getting quotas for user bde6ee9df10146d98991b0d4bb37fc48 and project e4b2b488b746454b9f93d67fa3c97809. Resources: {'key_pairs'} {{(pid=130059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:41:23.533804 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-00a1ceec-0219-4c13-b6a0-981bc9117cf4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.568379 Jul 12 17:41:23.534771 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 161/297] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Jul 12 17:41:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:41:23.542173 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-39b74232-2008-45ed-907c-c42cdc081609 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:23.545262 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-39b74232-2008-45ed-907c-c42cdc081609 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:23.563377 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-39b74232-2008-45ed-907c-c42cdc081609 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:23.565511 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-39b74232-2008-45ed-907c-c42cdc081609 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:23.566678 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-39b74232-2008-45ed-907c-c42cdc081609 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:23.567859 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-39b74232-2008-45ed-907c-c42cdc081609 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:23.762321 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-fc716f7b-d94f-4cad-9926-ef12b4e9a5c3 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:23.782078 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-fc716f7b-d94f-4cad-9926-ef12b4e9a5c3 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:23.785259 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-fc716f7b-d94f-4cad-9926-ef12b4e9a5c3 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:23.786918 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-fc716f7b-d94f-4cad-9926-ef12b4e9a5c3 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1721 microversion: 2.20 time: 0.471574 Jul 12 17:41:23.788710 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 137/298] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:41:23 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1721 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:41:24.050721 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-39b74232-2008-45ed-907c-c42cdc081609 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:24.061745 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-39b74232-2008-45ed-907c-c42cdc081609 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1510 microversion: 2.1 time: 0.525670 Jul 12 17:41:24.062857 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 162/299] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:23 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1510 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:24.797728 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-50f4b0f3-015d-42b3-a15d-069bbcc79d26 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Action: 'create', calling method: .version_select at 0x7f479ffd60d0>, body: {"keypair": {"name": "tempest-keypair-2127514372", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzkByVkOOXm6Veso75xd9N6/qCqVHqu5BhaPdTNpmll9aMAN31vo4M6WPyBHOW5mxtBIGLg47Xp/oCYUIXyb0UJ6qI3RgScSKyzVhMqPnOuIKR6IIoAfV6kzgPpaX3OdA=="}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:41:24.817267 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-f7516c7b-f049-4746-85d8-56fc2f43eefa tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:24.818104 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-f7516c7b-f049-4746-85d8-56fc2f43eefa tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:24.832219 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f7516c7b-f049-4746-85d8-56fc2f43eefa tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:24.835623 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f7516c7b-f049-4746-85d8-56fc2f43eefa tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:24.836590 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f7516c7b-f049-4746-85d8-56fc2f43eefa tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:24.838831 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f7516c7b-f049-4746-85d8-56fc2f43eefa tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:24.844852 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-50f4b0f3-015d-42b3-a15d-069bbcc79d26 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Getting quotas for project 84b840eaa59d4f73ac68926437f03d82. Resources: {'key_pairs'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:41:24.849863 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-50f4b0f3-015d-42b3-a15d-069bbcc79d26 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Getting quotas for user c8441a4a72154ee3bbb95af66abf2ffd and project 84b840eaa59d4f73ac68926437f03d82. Resources: {'key_pairs'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:41:25.045913 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-f7516c7b-f049-4746-85d8-56fc2f43eefa tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:25.057766 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-f7516c7b-f049-4746-85d8-56fc2f43eefa tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:25.059426 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-f7516c7b-f049-4746-85d8-56fc2f43eefa tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:25.060631 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-f7516c7b-f049-4746-85d8-56fc2f43eefa tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1721 microversion: 2.20 time: 0.248458 Jul 12 17:41:25.061174 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 163/300] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:41:24 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1721 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:41:25.078300 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-50f4b0f3-015d-42b3-a15d-069bbcc79d26 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.284507 Jul 12 17:41:25.079595 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 138/301] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Jul 12 17:41:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:41:25.097339 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-b6224794-433b-4c95-ae99-b5b0445534dc tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:25.098744 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-b6224794-433b-4c95-ae99-b5b0445534dc tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:25.114262 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b6224794-433b-4c95-ae99-b5b0445534dc tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:25.115074 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b6224794-433b-4c95-ae99-b5b0445534dc tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:25.115761 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b6224794-433b-4c95-ae99-b5b0445534dc tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:25.116385 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b6224794-433b-4c95-ae99-b5b0445534dc tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:25.295246 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-b6224794-433b-4c95-ae99-b5b0445534dc tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:25.304593 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-b6224794-433b-4c95-ae99-b5b0445534dc tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1510 microversion: 2.1 time: 0.221243 Jul 12 17:41:25.306627 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 164/302] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:25 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1510 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:26.087530 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-d1280af5-880a-412a-9432-f1f23176faf2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:26.091276 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-d1280af5-880a-412a-9432-f1f23176faf2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:26.117126 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d1280af5-880a-412a-9432-f1f23176faf2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:26.117892 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d1280af5-880a-412a-9432-f1f23176faf2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:26.119739 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d1280af5-880a-412a-9432-f1f23176faf2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:26.120967 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d1280af5-880a-412a-9432-f1f23176faf2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:26.327092 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-fc909553-4a3c-49e1-9a81-27167f059eb4 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:26.329717 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-fc909553-4a3c-49e1-9a81-27167f059eb4 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:26.341152 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fc909553-4a3c-49e1-9a81-27167f059eb4 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:26.343301 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fc909553-4a3c-49e1-9a81-27167f059eb4 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:26.344572 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fc909553-4a3c-49e1-9a81-27167f059eb4 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:26.345608 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fc909553-4a3c-49e1-9a81-27167f059eb4 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:26.472600 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-d1280af5-880a-412a-9432-f1f23176faf2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:26.476344 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:41:26.485799 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-d1280af5-880a-412a-9432-f1f23176faf2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:26.488491 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-d1280af5-880a-412a-9432-f1f23176faf2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:26.490677 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-d1280af5-880a-412a-9432-f1f23176faf2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1721 microversion: 2.20 time: 0.413341 Jul 12 17:41:26.504732 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 139/303] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:41:26 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1721 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:41:26.681102 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-fc909553-4a3c-49e1-9a81-27167f059eb4 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:26.698286 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-fc909553-4a3c-49e1-9a81-27167f059eb4 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1510 microversion: 2.1 time: 0.377987 Jul 12 17:41:26.704589 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 165/304] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:26 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1510 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:41:27.511770 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-fb0ff5a7-500c-4f3a-8da9-486c8d898bfb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:27.512390 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-fb0ff5a7-500c-4f3a-8da9-486c8d898bfb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:27.521390 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fb0ff5a7-500c-4f3a-8da9-486c8d898bfb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:27.521846 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fb0ff5a7-500c-4f3a-8da9-486c8d898bfb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:27.522730 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fb0ff5a7-500c-4f3a-8da9-486c8d898bfb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:27.528472 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fb0ff5a7-500c-4f3a-8da9-486c8d898bfb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:27.720401 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-91769c36-3cdd-4bfb-aebc-75b33ee1e166 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:27.721204 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-91769c36-3cdd-4bfb-aebc-75b33ee1e166 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:27.736737 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-91769c36-3cdd-4bfb-aebc-75b33ee1e166 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:27.737748 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-91769c36-3cdd-4bfb-aebc-75b33ee1e166 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:27.738668 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-91769c36-3cdd-4bfb-aebc-75b33ee1e166 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:27.739159 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-91769c36-3cdd-4bfb-aebc-75b33ee1e166 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:27.957597 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-fb0ff5a7-500c-4f3a-8da9-486c8d898bfb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:28.024059 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-fb0ff5a7-500c-4f3a-8da9-486c8d898bfb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:28.031345 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-fb0ff5a7-500c-4f3a-8da9-486c8d898bfb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:28.044163 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-fb0ff5a7-500c-4f3a-8da9-486c8d898bfb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1721 microversion: 2.20 time: 0.536946 Jul 12 17:41:28.063750 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 140/305] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:41:27 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1721 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:41:28.120640 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-91769c36-3cdd-4bfb-aebc-75b33ee1e166 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:28.133166 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-91769c36-3cdd-4bfb-aebc-75b33ee1e166 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1510 microversion: 2.1 time: 0.417594 Jul 12 17:41:28.134332 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 166/306] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:27 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1510 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:41:29.070677 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-c1437310-6db0-4a67-a837-0b54d7d01f44 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:29.072446 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-c1437310-6db0-4a67-a837-0b54d7d01f44 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:29.080887 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c1437310-6db0-4a67-a837-0b54d7d01f44 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:29.085105 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c1437310-6db0-4a67-a837-0b54d7d01f44 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:29.085433 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-2a452e95-5981-49b6-b23c-6391bc1d923d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-491847254", "imageRef": "cb077f42-97cd-41cf-8758-764c562534f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "788020f8-05a4-4c17-a8ec-9f084f5359c6"}], "security_groups": [{"name": "tempest-securitygroup--574065814"}], "key_name": "tempest-keypair-2127514372", "user_data": "}} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:41:29.087586 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c1437310-6db0-4a67-a837-0b54d7d01f44 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:29.088652 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c1437310-6db0-4a67-a837-0b54d7d01f44 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:29.309315 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-c1437310-6db0-4a67-a837-0b54d7d01f44 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:29.324731 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.network.neutron [None req-2a452e95-5981-49b6-b23c-6391bc1d923d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] validate_networks() for [('788020f8-05a4-4c17-a8ec-9f084f5359c6', None, None, None, None, None)] {{(pid=130059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:41:29.332236 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-c1437310-6db0-4a67-a837-0b54d7d01f44 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:29.334368 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-c1437310-6db0-4a67-a837-0b54d7d01f44 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:29.336212 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-c1437310-6db0-4a67-a837-0b54d7d01f44 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1721 microversion: 2.20 time: 0.271233 Jul 12 17:41:29.336850 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 141/307] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:41:29 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1721 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:41:29.343903 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-6b17a134-efe5-45dc-b159-8b028379f85e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:29.345266 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-6b17a134-efe5-45dc-b159-8b028379f85e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:29.394923 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6b17a134-efe5-45dc-b159-8b028379f85e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:29.395853 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6b17a134-efe5-45dc-b159-8b028379f85e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:29.397331 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6b17a134-efe5-45dc-b159-8b028379f85e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:29.398456 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6b17a134-efe5-45dc-b159-8b028379f85e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:29.685189 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-6b17a134-efe5-45dc-b159-8b028379f85e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:29.700173 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-6b17a134-efe5-45dc-b159-8b028379f85e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1516 microversion: 2.1 time: 0.361126 Jul 12 17:41:29.701653 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 142/308] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:29 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1516 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:30.028835 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-2a452e95-5981-49b6-b23c-6391bc1d923d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Flavor limits 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:41:30.029512 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-2a452e95-5981-49b6-b23c-6391bc1d923d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Image limits 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:41:30.030168 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-2a452e95-5981-49b6-b23c-6391bc1d923d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Flavor pref 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:41:30.030858 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-2a452e95-5981-49b6-b23c-6391bc1d923d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Image pref 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:41:30.031993 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-2a452e95-5981-49b6-b23c-6391bc1d923d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:41:30.041945 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2a452e95-5981-49b6-b23c-6391bc1d923d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:30.042395 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2a452e95-5981-49b6-b23c-6391bc1d923d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:30.043458 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2a452e95-5981-49b6-b23c-6391bc1d923d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:30.043942 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2a452e95-5981-49b6-b23c-6391bc1d923d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:30.064700 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.quota [None req-2a452e95-5981-49b6-b23c-6391bc1d923d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Getting quotas for project 84b840eaa59d4f73ac68926437f03d82. Resources: {'cores', 'instances', 'ram'} {{(pid=130059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:41:30.070113 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.quota [None req-2a452e95-5981-49b6-b23c-6391bc1d923d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Getting quotas for user c8441a4a72154ee3bbb95af66abf2ffd and project 84b840eaa59d4f73ac68926437f03d82. Resources: {'cores', 'instances', 'ram'} {{(pid=130059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:41:30.239370 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-2a452e95-5981-49b6-b23c-6391bc1d923d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Going to run 1 instances... {{(pid=130059) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:41:30.239370 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-2a452e95-5981-49b6-b23c-6391bc1d923d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb077f42-97cd-41cf-8758-764c562534f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:41:30.384865 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-03ae71b3-4932-4e26-95bb-f0c03a571dd0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:30.386257 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-03ae71b3-4932-4e26-95bb-f0c03a571dd0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:30.394985 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-03ae71b3-4932-4e26-95bb-f0c03a571dd0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:30.395447 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-03ae71b3-4932-4e26-95bb-f0c03a571dd0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:30.396231 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-03ae71b3-4932-4e26-95bb-f0c03a571dd0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:30.396913 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-03ae71b3-4932-4e26-95bb-f0c03a571dd0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:30.587239 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-2a452e95-5981-49b6-b23c-6391bc1d923d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.519094 Jul 12 17:41:30.591566 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-03ae71b3-4932-4e26-95bb-f0c03a571dd0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:30.597696 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 167/309] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 12 17:41:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 1533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:41:30.603463 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-03ae71b3-4932-4e26-95bb-f0c03a571dd0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:30.605488 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-03ae71b3-4932-4e26-95bb-f0c03a571dd0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:30.607012 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-03ae71b3-4932-4e26-95bb-f0c03a571dd0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1721 microversion: 2.20 time: 0.237792 Jul 12 17:41:30.611129 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 143/310] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:41:30 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1721 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:41:30.611384 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-60c1909e-7af6-4251-9938-dadce705f8f1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:30.614992 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-60c1909e-7af6-4251-9938-dadce705f8f1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:30.692665 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-60c1909e-7af6-4251-9938-dadce705f8f1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:30.718133 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-60c1909e-7af6-4251-9938-dadce705f8f1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd" status: 200 len: 1241 microversion: 2.1 time: 0.115764 Jul 12 17:41:30.723823 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 168/311] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:30 2022] GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd => generated 1241 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:31.638544 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-bef1d55c-6fb9-49a8-a94e-f32e0105b68b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:31.640166 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-bef1d55c-6fb9-49a8-a94e-f32e0105b68b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:31.651991 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bef1d55c-6fb9-49a8-a94e-f32e0105b68b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:31.655541 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bef1d55c-6fb9-49a8-a94e-f32e0105b68b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:31.657227 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bef1d55c-6fb9-49a8-a94e-f32e0105b68b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:31.657775 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bef1d55c-6fb9-49a8-a94e-f32e0105b68b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:31.749946 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-17c68c91-1bba-448e-a822-3a0928e96a91 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:31.751033 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-17c68c91-1bba-448e-a822-3a0928e96a91 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:31.840920 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-17c68c91-1bba-448e-a822-3a0928e96a91 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:31.850351 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-17c68c91-1bba-448e-a822-3a0928e96a91 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd" status: 200 len: 1241 microversion: 2.1 time: 0.106458 Jul 12 17:41:31.852892 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 169/312] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:31 2022] GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd => generated 1241 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:31.954617 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-bef1d55c-6fb9-49a8-a94e-f32e0105b68b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:31.969540 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-bef1d55c-6fb9-49a8-a94e-f32e0105b68b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:31.972838 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-bef1d55c-6fb9-49a8-a94e-f32e0105b68b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:31.975213 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-bef1d55c-6fb9-49a8-a94e-f32e0105b68b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1721 microversion: 2.20 time: 0.349909 Jul 12 17:41:31.976273 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 144/313] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:41:31 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1721 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:41:32.857590 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-2ee60547-c9f6-4026-87a2-9a84ebf2e683 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Action: 'create', calling method: .version_select at 0x7f479fe57d30>, body: {"keypair": {"name": "tempest-keypair-1052461520", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/K4UcTysh0LUkKiQu9yZfnjgfyuUOehkv9LbRp7RDIskUNrATgPoko9u8jGiQwxc5huwSdzhrluu9i1EkJzGzJKpuw+m6erWySNMsH4ahVdhJxGlEmQ/p4t4KONbwJfg=="}} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:41:32.880054 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-50d83141-1c06-4ab0-96b2-d6c054f2610e tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:32.880054 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-50d83141-1c06-4ab0-96b2-d6c054f2610e tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:32.881943 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.quota [None req-2ee60547-c9f6-4026-87a2-9a84ebf2e683 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Getting quotas for project 497c73f9a78743e9b24b2b6ff47d7ede. Resources: {'key_pairs'} {{(pid=130059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:41:32.889997 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.quota [None req-2ee60547-c9f6-4026-87a2-9a84ebf2e683 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Getting quotas for user ce09df98c929416e8ca67b0728349bfb and project 497c73f9a78743e9b24b2b6ff47d7ede. Resources: {'key_pairs'} {{(pid=130059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:41:32.892513 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-50d83141-1c06-4ab0-96b2-d6c054f2610e tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:32.893989 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-50d83141-1c06-4ab0-96b2-d6c054f2610e tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:32.895242 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-50d83141-1c06-4ab0-96b2-d6c054f2610e tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:32.895859 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-50d83141-1c06-4ab0-96b2-d6c054f2610e tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:32.993817 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-50d83141-1c06-4ab0-96b2-d6c054f2610e tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:33.011303 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-50d83141-1c06-4ab0-96b2-d6c054f2610e tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd" status: 200 len: 1237 microversion: 2.1 time: 0.144310 Jul 12 17:41:33.012236 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 145/314] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:32 2022] GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd => generated 1237 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:33.024076 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-70a6f5ac-0bdd-472a-ae64-95e66a0fd80f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:33.025281 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-70a6f5ac-0bdd-472a-ae64-95e66a0fd80f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:33.035912 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-70a6f5ac-0bdd-472a-ae64-95e66a0fd80f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:33.045549 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-70a6f5ac-0bdd-472a-ae64-95e66a0fd80f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:33.049237 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-2ee60547-c9f6-4026-87a2-9a84ebf2e683 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.195258 Jul 12 17:41:33.064072 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 170/315] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Jul 12 17:41:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:41:33.069297 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-70a6f5ac-0bdd-472a-ae64-95e66a0fd80f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:33.070898 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-70a6f5ac-0bdd-472a-ae64-95e66a0fd80f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:33.422664 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-70a6f5ac-0bdd-472a-ae64-95e66a0fd80f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:33.435589 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-70a6f5ac-0bdd-472a-ae64-95e66a0fd80f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:33.437480 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-70a6f5ac-0bdd-472a-ae64-95e66a0fd80f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:33.440653 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-70a6f5ac-0bdd-472a-ae64-95e66a0fd80f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1721 microversion: 2.20 time: 0.426890 Jul 12 17:41:33.455200 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 146/316] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:41:33 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1721 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:41:34.036717 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-20b0b460-b3a9-49a0-859d-a94d0d212e97 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:34.040131 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-20b0b460-b3a9-49a0-859d-a94d0d212e97 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:34.091818 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-20b0b460-b3a9-49a0-859d-a94d0d212e97 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:34.092292 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-20b0b460-b3a9-49a0-859d-a94d0d212e97 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:34.093162 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-20b0b460-b3a9-49a0-859d-a94d0d212e97 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:34.093620 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-20b0b460-b3a9-49a0-859d-a94d0d212e97 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:34.243588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-20b0b460-b3a9-49a0-859d-a94d0d212e97 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:34.252871 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-20b0b460-b3a9-49a0-859d-a94d0d212e97 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd" status: 200 len: 1311 microversion: 2.1 time: 0.226262 Jul 12 17:41:34.264557 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 171/317] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:34 2022] GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd => generated 1311 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:34.467310 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-616a0a50-2b53-4961-a493-009d2758b9fb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:34.468344 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-616a0a50-2b53-4961-a493-009d2758b9fb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:34.478890 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-616a0a50-2b53-4961-a493-009d2758b9fb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:34.480912 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-616a0a50-2b53-4961-a493-009d2758b9fb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:34.481425 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-616a0a50-2b53-4961-a493-009d2758b9fb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:34.481920 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-616a0a50-2b53-4961-a493-009d2758b9fb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:34.795677 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-616a0a50-2b53-4961-a493-009d2758b9fb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:34.808985 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-616a0a50-2b53-4961-a493-009d2758b9fb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:34.810709 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-616a0a50-2b53-4961-a493-009d2758b9fb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:34.811955 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-616a0a50-2b53-4961-a493-009d2758b9fb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1721 microversion: 2.20 time: 0.352272 Jul 12 17:41:34.812547 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 147/318] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:41:34 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1721 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:41:35.271057 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-9ca2c000-9023-4d93-8782-b1df4ce1599f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:35.271710 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-9ca2c000-9023-4d93-8782-b1df4ce1599f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:35.279483 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9ca2c000-9023-4d93-8782-b1df4ce1599f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:35.279934 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9ca2c000-9023-4d93-8782-b1df4ce1599f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:35.280721 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9ca2c000-9023-4d93-8782-b1df4ce1599f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:35.281804 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9ca2c000-9023-4d93-8782-b1df4ce1599f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:35.299895 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:41:35.851460 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-ed50cb56-d374-4e9b-940d-7084188cae01 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:35.855275 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-ed50cb56-d374-4e9b-940d-7084188cae01 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:35.865705 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell0:SELECT=4 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:41:35.894380 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ed50cb56-d374-4e9b-940d-7084188cae01 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:35.896381 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ed50cb56-d374-4e9b-940d-7084188cae01 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:35.899504 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ed50cb56-d374-4e9b-940d-7084188cae01 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:35.902783 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ed50cb56-d374-4e9b-940d-7084188cae01 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:36.112176 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-9ca2c000-9023-4d93-8782-b1df4ce1599f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:36.126167 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-9ca2c000-9023-4d93-8782-b1df4ce1599f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd" status: 200 len: 1366 microversion: 2.1 time: 0.858612 Jul 12 17:41:36.130451 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 172/319] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:35 2022] GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd => generated 1366 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:36.385896 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ed50cb56-d374-4e9b-940d-7084188cae01 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:36.431284 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ed50cb56-d374-4e9b-940d-7084188cae01 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:36.454630 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ed50cb56-d374-4e9b-940d-7084188cae01 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:36.464937 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-ed50cb56-d374-4e9b-940d-7084188cae01 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1721 microversion: 2.20 time: 0.629959 Jul 12 17:41:36.468135 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 148/320] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:41:35 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1721 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:41:37.163073 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-8763bc84-1ec7-4f56-9f19-c968766ee3f5 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:37.168450 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-8763bc84-1ec7-4f56-9f19-c968766ee3f5 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:37.190151 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:41:37.211017 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8763bc84-1ec7-4f56-9f19-c968766ee3f5 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:37.212516 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8763bc84-1ec7-4f56-9f19-c968766ee3f5 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:37.214610 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8763bc84-1ec7-4f56-9f19-c968766ee3f5 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:37.220209 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8763bc84-1ec7-4f56-9f19-c968766ee3f5 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:37.499589 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-418a88bf-a6bd-433b-aea8-373a0b6e52c8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:37.500247 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-418a88bf-a6bd-433b-aea8-373a0b6e52c8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:37.522464 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-418a88bf-a6bd-433b-aea8-373a0b6e52c8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:37.525986 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-418a88bf-a6bd-433b-aea8-373a0b6e52c8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:37.530849 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-418a88bf-a6bd-433b-aea8-373a0b6e52c8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:37.533042 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-418a88bf-a6bd-433b-aea8-373a0b6e52c8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:37.791334 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-8763bc84-1ec7-4f56-9f19-c968766ee3f5 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:37.839670 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-8763bc84-1ec7-4f56-9f19-c968766ee3f5 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd" status: 200 len: 1366 microversion: 2.1 time: 0.693383 Jul 12 17:41:37.843429 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 173/321] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:37 2022] GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd => generated 1366 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:37.878550 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-6a415d7a-4c60-4248-813c-d06769ec6010 req-79386170-f8f8-4828-b917-c5152700a16a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfbdba37-86d8-477a-95a8-9bef8b6df8dd", "tag": "7b3f7474-31df-4980-b89d-6bb57a621f7b"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:41:37.900551 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-6a415d7a-4c60-4248-813c-d06769ec6010 req-79386170-f8f8-4828-b917-c5152700a16a service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:37.900992 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-6a415d7a-4c60-4248-813c-d06769ec6010 req-79386170-f8f8-4828-b917-c5152700a16a service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:37.942689 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-6a415d7a-4c60-4248-813c-d06769ec6010 req-79386170-f8f8-4828-b917-c5152700a16a service nova] Creating event network-changed:7b3f7474-31df-4980-b89d-6bb57a621f7b for instance dfbdba37-86d8-477a-95a8-9bef8b6df8dd on hv-cinder-84875 Jul 12 17:41:37.960209 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-6a415d7a-4c60-4248-813c-d06769ec6010 req-79386170-f8f8-4828-b917-c5152700a16a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113877 Jul 12 17:41:37.968440 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 174/322] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:41:38.010703 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-33d41f32-9638-4dc5-b828-9bba5665aaee tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-65557223", "imageRef": "cb077f42-97cd-41cf-8758-764c562534f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "08bf24d0-d7c4-4e21-b068-c78f4d445841"}], "security_groups": [{"name": "tempest-securitygroup--19278751"}], "key_name": "tempest-keypair-1052461520", "user_data": "}} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:41:38.230588 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-418a88bf-a6bd-433b-aea8-373a0b6e52c8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:38.244979 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-418a88bf-a6bd-433b-aea8-373a0b6e52c8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:38.248171 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-418a88bf-a6bd-433b-aea8-373a0b6e52c8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:38.257389 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-418a88bf-a6bd-433b-aea8-373a0b6e52c8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1742 microversion: 2.20 time: 0.763737 Jul 12 17:41:38.269872 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 149/323] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:41:37 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1742 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:41:38.878287 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-1809a7bc-6dd3-4d3b-b62a-5d331a1bf9cf tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:38.889963 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-1809a7bc-6dd3-4d3b-b62a-5d331a1bf9cf tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:38.910242 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1809a7bc-6dd3-4d3b-b62a-5d331a1bf9cf tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:38.917770 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1809a7bc-6dd3-4d3b-b62a-5d331a1bf9cf tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:38.923380 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1809a7bc-6dd3-4d3b-b62a-5d331a1bf9cf tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:38.923380 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1809a7bc-6dd3-4d3b-b62a-5d331a1bf9cf tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:39.311968 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-1809a7bc-6dd3-4d3b-b62a-5d331a1bf9cf tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:39.326119 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-1809a7bc-6dd3-4d3b-b62a-5d331a1bf9cf tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd" status: 200 len: 1366 microversion: 2.1 time: 0.454764 Jul 12 17:41:39.328902 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 150/324] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:38 2022] GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd => generated 1366 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:41:39.336140 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-fd9f90dc-1713-49be-bab7-a9eac4758d0a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:39.338780 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-fd9f90dc-1713-49be-bab7-a9eac4758d0a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:39.352832 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fd9f90dc-1713-49be-bab7-a9eac4758d0a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:39.353765 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fd9f90dc-1713-49be-bab7-a9eac4758d0a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:39.354692 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fd9f90dc-1713-49be-bab7-a9eac4758d0a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:39.355249 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fd9f90dc-1713-49be-bab7-a9eac4758d0a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:39.596147 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-fd9f90dc-1713-49be-bab7-a9eac4758d0a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:39.605155 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-fd9f90dc-1713-49be-bab7-a9eac4758d0a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:39.607051 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-fd9f90dc-1713-49be-bab7-a9eac4758d0a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:39.614030 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-fd9f90dc-1713-49be-bab7-a9eac4758d0a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1742 microversion: 2.20 time: 0.283260 Jul 12 17:41:39.614921 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 151/325] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:41:39 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1742 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:41:40.057513 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell0:SELECT=2 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:41:40.347642 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-6da9679f-3618-47d1-8ba0-e2d31c343be1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:40.349984 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-6da9679f-3618-47d1-8ba0-e2d31c343be1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:40.359771 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6da9679f-3618-47d1-8ba0-e2d31c343be1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:40.360769 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6da9679f-3618-47d1-8ba0-e2d31c343be1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:40.363313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6da9679f-3618-47d1-8ba0-e2d31c343be1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:40.364104 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6da9679f-3618-47d1-8ba0-e2d31c343be1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:40.655199 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-6da9679f-3618-47d1-8ba0-e2d31c343be1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:40.680094 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-6da9679f-3618-47d1-8ba0-e2d31c343be1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd" status: 200 len: 1366 microversion: 2.1 time: 0.328764 Jul 12 17:41:40.680094 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 152/326] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:40 2022] GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd => generated 1366 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:40.680094 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-2c52d2aa-acc1-43f0-847d-2ec001866b36 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:40.680094 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-2c52d2aa-acc1-43f0-847d-2ec001866b36 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:40.719740 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2c52d2aa-acc1-43f0-847d-2ec001866b36 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:40.721339 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2c52d2aa-acc1-43f0-847d-2ec001866b36 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:40.723053 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2c52d2aa-acc1-43f0-847d-2ec001866b36 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:40.723704 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2c52d2aa-acc1-43f0-847d-2ec001866b36 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:41.025244 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-2c52d2aa-acc1-43f0-847d-2ec001866b36 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:41.045037 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-2c52d2aa-acc1-43f0-847d-2ec001866b36 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:41.048978 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-2c52d2aa-acc1-43f0-847d-2ec001866b36 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:41.050847 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-2c52d2aa-acc1-43f0-847d-2ec001866b36 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1737 microversion: 2.20 time: 0.377937 Jul 12 17:41:41.052154 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 153/327] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:41:40 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1737 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:41:41.765575 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-13a2ac4d-275a-4b66-9d35-bca0c97af164 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:41.765575 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-13a2ac4d-275a-4b66-9d35-bca0c97af164 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:41.788019 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-13a2ac4d-275a-4b66-9d35-bca0c97af164 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:41.790334 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-13a2ac4d-275a-4b66-9d35-bca0c97af164 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:41.793588 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-13a2ac4d-275a-4b66-9d35-bca0c97af164 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:41.795464 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-13a2ac4d-275a-4b66-9d35-bca0c97af164 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:42.115717 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-13a2ac4d-275a-4b66-9d35-bca0c97af164 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:42.129602 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-13a2ac4d-275a-4b66-9d35-bca0c97af164 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd" status: 200 len: 1366 microversion: 2.1 time: 0.379499 Jul 12 17:41:42.131823 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 154/328] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:41 2022] GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd => generated 1366 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:42.142512 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-1815212f-a8bc-4134-8c47-8d8780d348d4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:42.152940 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-1815212f-a8bc-4134-8c47-8d8780d348d4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:42.168074 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1815212f-a8bc-4134-8c47-8d8780d348d4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:42.169087 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1815212f-a8bc-4134-8c47-8d8780d348d4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:42.171272 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1815212f-a8bc-4134-8c47-8d8780d348d4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:42.172447 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1815212f-a8bc-4134-8c47-8d8780d348d4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:42.920003 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell0:SELECT=18 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:41:43.087957 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-1815212f-a8bc-4134-8c47-8d8780d348d4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:43.141674 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-1815212f-a8bc-4134-8c47-8d8780d348d4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:43.152758 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-1815212f-a8bc-4134-8c47-8d8780d348d4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:43.155939 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-1815212f-a8bc-4134-8c47-8d8780d348d4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1737 microversion: 2.20 time: 1.022484 Jul 12 17:41:43.164784 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 155/329] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:41:42 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1737 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:41:43.181258 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-09af7aeb-ac9a-4222-ada3-de837272f4fe tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:43.184552 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-09af7aeb-ac9a-4222-ada3-de837272f4fe tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:43.205276 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-09af7aeb-ac9a-4222-ada3-de837272f4fe tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:43.206278 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-09af7aeb-ac9a-4222-ada3-de837272f4fe tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:43.207948 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-09af7aeb-ac9a-4222-ada3-de837272f4fe tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:43.208937 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-09af7aeb-ac9a-4222-ada3-de837272f4fe tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:43.243462 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=100 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:41:43.417784 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-09af7aeb-ac9a-4222-ada3-de837272f4fe tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:43.428584 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-09af7aeb-ac9a-4222-ada3-de837272f4fe tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd" status: 200 len: 1366 microversion: 2.1 time: 0.263046 Jul 12 17:41:43.429728 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 156/330] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:43 2022] GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:43.434766 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-d3b9d3bb-b3f6-4f5c-a244-80953e65bb0c req-20b4b665-51fc-4b54-9b96-56d3d30200b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f88418d-5f96-4c05-adf4-09d83f045699", "name": "network-vif-plugged", "status": "completed", "tag": "082490a4-d27d-40c5-93fa-92a28b71e068"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:41:43.444746 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-d3b9d3bb-b3f6-4f5c-a244-80953e65bb0c req-20b4b665-51fc-4b54-9b96-56d3d30200b1 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:43.447250 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-d3b9d3bb-b3f6-4f5c-a244-80953e65bb0c req-20b4b665-51fc-4b54-9b96-56d3d30200b1 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:43.458598 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-d3b9d3bb-b3f6-4f5c-a244-80953e65bb0c req-20b4b665-51fc-4b54-9b96-56d3d30200b1 service nova] Creating event network-vif-plugged:082490a4-d27d-40c5-93fa-92a28b71e068 for instance 7f88418d-5f96-4c05-adf4-09d83f045699 on hv-cinder-84875 Jul 12 17:41:43.466999 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-d3b9d3bb-b3f6-4f5c-a244-80953e65bb0c req-20b4b665-51fc-4b54-9b96-56d3d30200b1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034347 Jul 12 17:41:43.473415 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 157/331] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:41:44.192521 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-84ae9c62-c8db-4ef7-ab64-d8f2ac964148 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:44.193297 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-84ae9c62-c8db-4ef7-ab64-d8f2ac964148 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:44.202976 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-84ae9c62-c8db-4ef7-ab64-d8f2ac964148 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:44.204472 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-84ae9c62-c8db-4ef7-ab64-d8f2ac964148 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:44.206178 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-84ae9c62-c8db-4ef7-ab64-d8f2ac964148 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:44.206861 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-84ae9c62-c8db-4ef7-ab64-d8f2ac964148 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:44.448213 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-84ae9c62-c8db-4ef7-ab64-d8f2ac964148 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:44.463786 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-84ae9c62-c8db-4ef7-ab64-d8f2ac964148 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:44.465881 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-84ae9c62-c8db-4ef7-ab64-d8f2ac964148 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:44.467599 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-84ae9c62-c8db-4ef7-ab64-d8f2ac964148 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1737 microversion: 2.20 time: 0.281046 Jul 12 17:41:44.468485 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 158/332] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:41:44 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1737 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:41:44.473431 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-7b08d005-06b8-491b-a560-6d587377ce03 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:44.474243 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-7b08d005-06b8-491b-a560-6d587377ce03 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:44.481159 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7b08d005-06b8-491b-a560-6d587377ce03 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:44.481814 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7b08d005-06b8-491b-a560-6d587377ce03 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:44.482733 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7b08d005-06b8-491b-a560-6d587377ce03 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:44.483324 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7b08d005-06b8-491b-a560-6d587377ce03 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:44.707424 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-7b08d005-06b8-491b-a560-6d587377ce03 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:44.720763 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-7b08d005-06b8-491b-a560-6d587377ce03 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd" status: 200 len: 1366 microversion: 2.1 time: 0.250484 Jul 12 17:41:44.723792 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 159/333] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:44 2022] GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:45.488207 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-d86b3871-59c3-4bc6-9676-828f2f04ae5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:45.489695 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-d86b3871-59c3-4bc6-9676-828f2f04ae5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:45.497012 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d86b3871-59c3-4bc6-9676-828f2f04ae5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:45.497822 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d86b3871-59c3-4bc6-9676-828f2f04ae5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:45.498884 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d86b3871-59c3-4bc6-9676-828f2f04ae5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:45.499669 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d86b3871-59c3-4bc6-9676-828f2f04ae5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:45.781670 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-d86b3871-59c3-4bc6-9676-828f2f04ae5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:45.814740 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-d86b3871-59c3-4bc6-9676-828f2f04ae5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:45.817226 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-d86b3871-59c3-4bc6-9676-828f2f04ae5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:45.818534 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-d86b3871-59c3-4bc6-9676-828f2f04ae5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1737 microversion: 2.20 time: 0.335314 Jul 12 17:41:45.819598 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 160/334] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:41:45 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1737 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:41:45.826276 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-7c61eedf-fefd-4bea-a670-57fb7f7185d5 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:45.831489 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-7c61eedf-fefd-4bea-a670-57fb7f7185d5 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:45.849162 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7c61eedf-fefd-4bea-a670-57fb7f7185d5 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:45.853570 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7c61eedf-fefd-4bea-a670-57fb7f7185d5 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:45.854820 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7c61eedf-fefd-4bea-a670-57fb7f7185d5 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:45.855445 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7c61eedf-fefd-4bea-a670-57fb7f7185d5 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:46.177281 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-7c61eedf-fefd-4bea-a670-57fb7f7185d5 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:46.189055 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-7c61eedf-fefd-4bea-a670-57fb7f7185d5 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd" status: 200 len: 1366 microversion: 2.1 time: 0.365618 Jul 12 17:41:46.189055 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 161/335] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:45 2022] GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd => generated 1366 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:46.851636 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-1b9b9bb3-670e-4287-a8f8-b61e2753ca82 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:46.852309 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-1b9b9bb3-670e-4287-a8f8-b61e2753ca82 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:46.864656 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1b9b9bb3-670e-4287-a8f8-b61e2753ca82 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:46.865060 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1b9b9bb3-670e-4287-a8f8-b61e2753ca82 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:46.865886 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1b9b9bb3-670e-4287-a8f8-b61e2753ca82 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:46.866324 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1b9b9bb3-670e-4287-a8f8-b61e2753ca82 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:47.139641 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-1b9b9bb3-670e-4287-a8f8-b61e2753ca82 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:47.170777 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-1b9b9bb3-670e-4287-a8f8-b61e2753ca82 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:47.186423 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-1b9b9bb3-670e-4287-a8f8-b61e2753ca82 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:47.198935 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-1b9b9bb3-670e-4287-a8f8-b61e2753ca82 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1737 microversion: 2.20 time: 0.350768 Jul 12 17:41:47.212457 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 162/336] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:41:46 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1737 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:41:47.222067 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-7ac65303-b614-4575-ae1b-d3764dc5336c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:47.223466 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-7ac65303-b614-4575-ae1b-d3764dc5336c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:47.235521 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7ac65303-b614-4575-ae1b-d3764dc5336c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:47.235521 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7ac65303-b614-4575-ae1b-d3764dc5336c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:47.235521 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7ac65303-b614-4575-ae1b-d3764dc5336c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:47.235521 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7ac65303-b614-4575-ae1b-d3764dc5336c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:47.466572 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.network.neutron [None req-33d41f32-9638-4dc5-b828-9bba5665aaee tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] validate_networks() for [('08bf24d0-d7c4-4e21-b068-c78f4d445841', None, None, None, None, None)] {{(pid=130059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:41:47.514783 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-7ac65303-b614-4575-ae1b-d3764dc5336c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:47.530870 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-7ac65303-b614-4575-ae1b-d3764dc5336c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd" status: 200 len: 1366 microversion: 2.1 time: 0.310904 Jul 12 17:41:47.530870 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 163/337] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:47 2022] GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:47.920728 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=12 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:41:48.192642 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-33d41f32-9638-4dc5-b828-9bba5665aaee tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Flavor limits 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:41:48.193511 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-33d41f32-9638-4dc5-b828-9bba5665aaee tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Image limits 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:41:48.194203 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-33d41f32-9638-4dc5-b828-9bba5665aaee tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Flavor pref 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:41:48.194843 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-33d41f32-9638-4dc5-b828-9bba5665aaee tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Image pref 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:41:48.195458 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-33d41f32-9638-4dc5-b828-9bba5665aaee tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:41:48.217471 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-d255623a-0087-4955-80cf-b4c7ed06d461 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:48.218072 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-33d41f32-9638-4dc5-b828-9bba5665aaee tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:48.219546 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-d255623a-0087-4955-80cf-b4c7ed06d461 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:48.220732 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-33d41f32-9638-4dc5-b828-9bba5665aaee tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:48.222105 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-33d41f32-9638-4dc5-b828-9bba5665aaee tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:48.223102 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-33d41f32-9638-4dc5-b828-9bba5665aaee tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:48.232718 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d255623a-0087-4955-80cf-b4c7ed06d461 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:48.235563 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d255623a-0087-4955-80cf-b4c7ed06d461 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:48.235563 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d255623a-0087-4955-80cf-b4c7ed06d461 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:48.238792 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d255623a-0087-4955-80cf-b4c7ed06d461 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:48.327848 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.quota [None req-33d41f32-9638-4dc5-b828-9bba5665aaee tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Getting quotas for project 497c73f9a78743e9b24b2b6ff47d7ede. Resources: {'cores', 'instances', 'ram'} {{(pid=130059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:41:48.344046 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.quota [None req-33d41f32-9638-4dc5-b828-9bba5665aaee tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Getting quotas for user ce09df98c929416e8ca67b0728349bfb and project 497c73f9a78743e9b24b2b6ff47d7ede. Resources: {'cores', 'instances', 'ram'} {{(pid=130059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:41:48.371270 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-33d41f32-9638-4dc5-b828-9bba5665aaee tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Going to run 1 instances... {{(pid=130059) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:41:48.376131 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-33d41f32-9638-4dc5-b828-9bba5665aaee tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb077f42-97cd-41cf-8758-764c562534f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:41:48.537790 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-d255623a-0087-4955-80cf-b4c7ed06d461 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:48.564960 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-d255623a-0087-4955-80cf-b4c7ed06d461 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:48.569390 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-d255623a-0087-4955-80cf-b4c7ed06d461 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:48.572812 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-d255623a-0087-4955-80cf-b4c7ed06d461 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1737 microversion: 2.20 time: 0.359106 Jul 12 17:41:48.575705 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 164/338] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:41:48 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1737 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:41:48.578001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-33d41f32-9638-4dc5-b828-9bba5665aaee tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 10.603041 Jul 12 17:41:48.582564 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 175/339] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 12 17:41:37 2022] POST /compute/v2.1/servers => generated 407 bytes in 10613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:41:48.584633 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-5450aa47-73e3-4485-a363-3d9be73a87a6 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:48.586093 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-5450aa47-73e3-4485-a363-3d9be73a87a6 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:48.600532 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-651f1788-0eb5-48b4-8be0-bcdf4c5d8a34 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:48.601372 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-651f1788-0eb5-48b4-8be0-bcdf4c5d8a34 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:48.606302 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5450aa47-73e3-4485-a363-3d9be73a87a6 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:48.608157 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5450aa47-73e3-4485-a363-3d9be73a87a6 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:48.611299 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5450aa47-73e3-4485-a363-3d9be73a87a6 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:48.612746 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5450aa47-73e3-4485-a363-3d9be73a87a6 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:48.716099 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-651f1788-0eb5-48b4-8be0-bcdf4c5d8a34 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:48.723941 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-651f1788-0eb5-48b4-8be0-bcdf4c5d8a34 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1244 microversion: 2.1 time: 0.128764 Jul 12 17:41:48.728851 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 176/340] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:48 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1244 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:48.890576 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-5450aa47-73e3-4485-a363-3d9be73a87a6 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:48.926906 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-5450aa47-73e3-4485-a363-3d9be73a87a6 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd" status: 200 len: 1366 microversion: 2.1 time: 0.349811 Jul 12 17:41:48.929858 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 165/341] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:48 2022] GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:49.603602 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-c975d2b6-1847-4ca8-96c1-25f5da822362 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:49.604867 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-c975d2b6-1847-4ca8-96c1-25f5da822362 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:49.621625 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c975d2b6-1847-4ca8-96c1-25f5da822362 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:49.622144 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c975d2b6-1847-4ca8-96c1-25f5da822362 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:49.629336 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c975d2b6-1847-4ca8-96c1-25f5da822362 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:49.634069 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c975d2b6-1847-4ca8-96c1-25f5da822362 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:49.746684 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-0eababe3-a2fb-419a-9c19-ef425fc29173 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:49.747420 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-0eababe3-a2fb-419a-9c19-ef425fc29173 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:49.755517 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:41:49.824074 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0eababe3-a2fb-419a-9c19-ef425fc29173 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:49.832418 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-0eababe3-a2fb-419a-9c19-ef425fc29173 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1244 microversion: 2.1 time: 0.090460 Jul 12 17:41:49.834279 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 166/342] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:49 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1244 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:41:49.912652 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-c975d2b6-1847-4ca8-96c1-25f5da822362 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:49.926510 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-c975d2b6-1847-4ca8-96c1-25f5da822362 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:49.940115 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-c975d2b6-1847-4ca8-96c1-25f5da822362 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:49.944677 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-c975d2b6-1847-4ca8-96c1-25f5da822362 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1737 microversion: 2.20 time: 0.345241 Jul 12 17:41:49.945051 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-86760b4b-00a1-4ce4-a660-5f7bddccf07d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:49.945676 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-86760b4b-00a1-4ce4-a660-5f7bddccf07d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:49.948588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 177/343] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:41:49 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1737 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:41:49.957067 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-86760b4b-00a1-4ce4-a660-5f7bddccf07d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:49.957921 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-86760b4b-00a1-4ce4-a660-5f7bddccf07d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:49.967444 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-86760b4b-00a1-4ce4-a660-5f7bddccf07d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:49.968063 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-86760b4b-00a1-4ce4-a660-5f7bddccf07d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:50.256389 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-86760b4b-00a1-4ce4-a660-5f7bddccf07d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:50.278534 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-86760b4b-00a1-4ce4-a660-5f7bddccf07d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd" status: 200 len: 1366 microversion: 2.1 time: 0.337586 Jul 12 17:41:50.286856 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 167/344] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:49 2022] GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd => generated 1366 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:50.851873 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-cccef2f6-398c-486f-8ebb-07944585ef4a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:50.853245 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-cccef2f6-398c-486f-8ebb-07944585ef4a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:50.861536 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cccef2f6-398c-486f-8ebb-07944585ef4a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:50.862004 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cccef2f6-398c-486f-8ebb-07944585ef4a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:50.862836 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cccef2f6-398c-486f-8ebb-07944585ef4a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:50.863466 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cccef2f6-398c-486f-8ebb-07944585ef4a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:50.968225 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-03e03b08-c622-4fe6-8f9d-51f7b7d9720b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:50.969563 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-03e03b08-c622-4fe6-8f9d-51f7b7d9720b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:51.010246 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-03e03b08-c622-4fe6-8f9d-51f7b7d9720b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:51.010756 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-03e03b08-c622-4fe6-8f9d-51f7b7d9720b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:51.018310 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-03e03b08-c622-4fe6-8f9d-51f7b7d9720b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:51.021576 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-03e03b08-c622-4fe6-8f9d-51f7b7d9720b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:51.129698 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-cccef2f6-398c-486f-8ebb-07944585ef4a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:51.162769 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-cccef2f6-398c-486f-8ebb-07944585ef4a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1248 microversion: 2.1 time: 0.310566 Jul 12 17:41:51.165082 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 178/345] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:50 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1248 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:51.301635 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-d2bcf7e7-3fef-47fe-9bfb-66608d8a5629 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:51.303016 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-d2bcf7e7-3fef-47fe-9bfb-66608d8a5629 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:51.354762 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d2bcf7e7-3fef-47fe-9bfb-66608d8a5629 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:51.355215 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d2bcf7e7-3fef-47fe-9bfb-66608d8a5629 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:51.356081 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d2bcf7e7-3fef-47fe-9bfb-66608d8a5629 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:51.356534 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d2bcf7e7-3fef-47fe-9bfb-66608d8a5629 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:51.579969 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-03e03b08-c622-4fe6-8f9d-51f7b7d9720b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:51.597722 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-03e03b08-c622-4fe6-8f9d-51f7b7d9720b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:51.608373 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-03e03b08-c622-4fe6-8f9d-51f7b7d9720b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:51.610270 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-03e03b08-c622-4fe6-8f9d-51f7b7d9720b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1737 microversion: 2.20 time: 0.647162 Jul 12 17:41:51.612230 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 168/346] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:41:50 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1737 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:41:51.777049 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-d2bcf7e7-3fef-47fe-9bfb-66608d8a5629 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:51.789500 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-d2bcf7e7-3fef-47fe-9bfb-66608d8a5629 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd" status: 200 len: 1366 microversion: 2.1 time: 0.494205 Jul 12 17:41:51.793443 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 179/347] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:51 2022] GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd => generated 1366 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:52.188784 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-43049298-0b98-4cf4-8f8c-5aa8fd75e709 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:52.191922 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-43049298-0b98-4cf4-8f8c-5aa8fd75e709 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:52.220244 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-43049298-0b98-4cf4-8f8c-5aa8fd75e709 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:52.222371 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-43049298-0b98-4cf4-8f8c-5aa8fd75e709 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:52.223729 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-43049298-0b98-4cf4-8f8c-5aa8fd75e709 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:52.226279 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-43049298-0b98-4cf4-8f8c-5aa8fd75e709 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:52.630453 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-5c20bc73-e12f-44d5-a6ef-209469a10b49 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:52.631377 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-5c20bc73-e12f-44d5-a6ef-209469a10b49 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:52.659137 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5c20bc73-e12f-44d5-a6ef-209469a10b49 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:52.659752 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5c20bc73-e12f-44d5-a6ef-209469a10b49 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:52.660613 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5c20bc73-e12f-44d5-a6ef-209469a10b49 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:52.677097 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5c20bc73-e12f-44d5-a6ef-209469a10b49 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:52.812559 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-43049298-0b98-4cf4-8f8c-5aa8fd75e709 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:52.844196 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-43049298-0b98-4cf4-8f8c-5aa8fd75e709 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1304 microversion: 2.1 time: 0.666378 Jul 12 17:41:52.855278 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 169/348] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:52 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1304 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:52.874100 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-1cf4090b-eb04-4417-be02-143a150edc59 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:52.874772 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-1cf4090b-eb04-4417-be02-143a150edc59 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:52.911093 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1cf4090b-eb04-4417-be02-143a150edc59 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:52.933824 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1cf4090b-eb04-4417-be02-143a150edc59 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:52.933824 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1cf4090b-eb04-4417-be02-143a150edc59 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:52.933824 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1cf4090b-eb04-4417-be02-143a150edc59 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:53.112728 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-5c20bc73-e12f-44d5-a6ef-209469a10b49 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:53.123541 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-5c20bc73-e12f-44d5-a6ef-209469a10b49 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:53.127647 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-5c20bc73-e12f-44d5-a6ef-209469a10b49 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:53.129889 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-5c20bc73-e12f-44d5-a6ef-209469a10b49 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1737 microversion: 2.20 time: 0.503637 Jul 12 17:41:53.138162 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 180/349] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:41:52 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1737 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:41:53.574762 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-1cf4090b-eb04-4417-be02-143a150edc59 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:53.587576 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-1cf4090b-eb04-4417-be02-143a150edc59 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd" status: 200 len: 1366 microversion: 2.1 time: 0.731047 Jul 12 17:41:53.588486 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 170/350] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:52 2022] GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd => generated 1366 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:53.635020 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-4b713bba-659c-43d7-8801-d9407c3d9c79 req-5c6fb8f7-f343-4add-a088-d65bc5e9f0be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfbdba37-86d8-477a-95a8-9bef8b6df8dd", "name": "network-vif-plugged", "status": "completed", "tag": "7b3f7474-31df-4980-b89d-6bb57a621f7b"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:41:53.671732 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-4b713bba-659c-43d7-8801-d9407c3d9c79 req-5c6fb8f7-f343-4add-a088-d65bc5e9f0be service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:53.676159 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-4b713bba-659c-43d7-8801-d9407c3d9c79 req-5c6fb8f7-f343-4add-a088-d65bc5e9f0be service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:53.707520 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-4b713bba-659c-43d7-8801-d9407c3d9c79 req-5c6fb8f7-f343-4add-a088-d65bc5e9f0be service nova] Creating event network-vif-plugged:7b3f7474-31df-4980-b89d-6bb57a621f7b for instance dfbdba37-86d8-477a-95a8-9bef8b6df8dd on hv-cinder-84875 Jul 12 17:41:53.723306 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-4b713bba-659c-43d7-8801-d9407c3d9c79 req-5c6fb8f7-f343-4add-a088-d65bc5e9f0be service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093565 Jul 12 17:41:53.726317 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 181/351] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:41:53.881310 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-2a812f01-08fc-44f9-8fe5-7a483edead0c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:53.883013 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-2a812f01-08fc-44f9-8fe5-7a483edead0c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:53.928414 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2a812f01-08fc-44f9-8fe5-7a483edead0c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:53.934157 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2a812f01-08fc-44f9-8fe5-7a483edead0c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:53.942767 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2a812f01-08fc-44f9-8fe5-7a483edead0c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:53.943408 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2a812f01-08fc-44f9-8fe5-7a483edead0c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:54.161600 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-6cd8a512-990c-4949-bca5-aa75c6ea8cb1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:54.162776 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-6cd8a512-990c-4949-bca5-aa75c6ea8cb1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:54.182713 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6cd8a512-990c-4949-bca5-aa75c6ea8cb1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:54.186090 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6cd8a512-990c-4949-bca5-aa75c6ea8cb1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:54.192431 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6cd8a512-990c-4949-bca5-aa75c6ea8cb1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:54.197440 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6cd8a512-990c-4949-bca5-aa75c6ea8cb1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:54.319781 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-2a812f01-08fc-44f9-8fe5-7a483edead0c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:54.373540 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-2a812f01-08fc-44f9-8fe5-7a483edead0c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1302 microversion: 2.1 time: 0.488800 Jul 12 17:41:54.389289 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 171/352] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:53 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1302 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:54.611389 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-2f7945c5-771e-481b-b866-25c063548824 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:54.612548 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-2f7945c5-771e-481b-b866-25c063548824 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:54.618184 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-6cd8a512-990c-4949-bca5-aa75c6ea8cb1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:54.629150 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-6cd8a512-990c-4949-bca5-aa75c6ea8cb1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:54.631541 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-6cd8a512-990c-4949-bca5-aa75c6ea8cb1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:54.633240 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-6cd8a512-990c-4949-bca5-aa75c6ea8cb1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1737 microversion: 2.20 time: 0.478564 Jul 12 17:41:54.633918 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 182/353] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:41:54 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1737 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:41:54.639235 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2f7945c5-771e-481b-b866-25c063548824 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:54.640322 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2f7945c5-771e-481b-b866-25c063548824 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:54.642537 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2f7945c5-771e-481b-b866-25c063548824 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:54.643566 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2f7945c5-771e-481b-b866-25c063548824 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:55.319581 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-2f7945c5-771e-481b-b866-25c063548824 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:55.321625 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-2f7945c5-771e-481b-b866-25c063548824 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd" status: 200 len: 1366 microversion: 2.1 time: 0.719558 Jul 12 17:41:55.322552 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 172/354] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:54 2022] GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd => generated 1366 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:55.401878 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-abce9252-3970-492e-9298-0e86095f3ee7 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:55.403384 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-abce9252-3970-492e-9298-0e86095f3ee7 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:55.427200 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-abce9252-3970-492e-9298-0e86095f3ee7 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:55.427738 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-abce9252-3970-492e-9298-0e86095f3ee7 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:55.428752 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-abce9252-3970-492e-9298-0e86095f3ee7 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:55.429548 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-abce9252-3970-492e-9298-0e86095f3ee7 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:55.528993 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-abce9252-3970-492e-9298-0e86095f3ee7 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:55.550646 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-abce9252-3970-492e-9298-0e86095f3ee7 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1302 microversion: 2.1 time: 0.152663 Jul 12 17:41:55.560163 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 183/355] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:55 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1302 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:55.655975 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-55b8c85d-4f88-49dd-847f-0b0098b2317b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:55.658130 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-55b8c85d-4f88-49dd-847f-0b0098b2317b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:55.672641 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-55b8c85d-4f88-49dd-847f-0b0098b2317b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:55.673836 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-55b8c85d-4f88-49dd-847f-0b0098b2317b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:55.675564 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-55b8c85d-4f88-49dd-847f-0b0098b2317b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:55.676327 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-55b8c85d-4f88-49dd-847f-0b0098b2317b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:56.316361 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-55b8c85d-4f88-49dd-847f-0b0098b2317b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:56.350657 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-f6a6d008-1a2b-457e-8485-8b2ac3c15703 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:56.351316 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-f6a6d008-1a2b-457e-8485-8b2ac3c15703 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:56.354317 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-55b8c85d-4f88-49dd-847f-0b0098b2317b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:56.363071 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-55b8c85d-4f88-49dd-847f-0b0098b2317b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:56.374520 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-55b8c85d-4f88-49dd-847f-0b0098b2317b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1737 microversion: 2.20 time: 0.723468 Jul 12 17:41:56.383054 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f6a6d008-1a2b-457e-8485-8b2ac3c15703 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:56.384992 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f6a6d008-1a2b-457e-8485-8b2ac3c15703 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:56.386227 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f6a6d008-1a2b-457e-8485-8b2ac3c15703 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:56.387020 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 173/356] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:41:55 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1737 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:41:56.389938 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f6a6d008-1a2b-457e-8485-8b2ac3c15703 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:56.580031 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-4d02cf57-5c65-4094-aeba-6e5b9dda08b1 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:56.581019 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-4d02cf57-5c65-4094-aeba-6e5b9dda08b1 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:56.598134 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4d02cf57-5c65-4094-aeba-6e5b9dda08b1 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:56.600805 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4d02cf57-5c65-4094-aeba-6e5b9dda08b1 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:56.607821 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4d02cf57-5c65-4094-aeba-6e5b9dda08b1 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:56.610569 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4d02cf57-5c65-4094-aeba-6e5b9dda08b1 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:57.417611 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-4d02cf57-5c65-4094-aeba-6e5b9dda08b1 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:57.424750 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-f6a6d008-1a2b-457e-8485-8b2ac3c15703 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:57.429433 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=100 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:41:57.434278 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-f6a6d008-1a2b-457e-8485-8b2ac3c15703 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd" status: 200 len: 1366 microversion: 2.1 time: 1.095721 Jul 12 17:41:57.445969 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 184/357] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:56 2022] GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd => generated 1366 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:57.450797 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-4d02cf57-5c65-4094-aeba-6e5b9dda08b1 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1368 microversion: 2.1 time: 0.875577 Jul 12 17:41:57.457055 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 174/358] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:56 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1368 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:57.464235 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-68154648-2d1e-4d2d-b8f0-cb7510f10da5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:57.464851 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-68154648-2d1e-4d2d-b8f0-cb7510f10da5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:57.488107 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-68154648-2d1e-4d2d-b8f0-cb7510f10da5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:57.489412 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-68154648-2d1e-4d2d-b8f0-cb7510f10da5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:57.490401 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-68154648-2d1e-4d2d-b8f0-cb7510f10da5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:57.491245 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-68154648-2d1e-4d2d-b8f0-cb7510f10da5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:58.196267 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-68154648-2d1e-4d2d-b8f0-cb7510f10da5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:58.218210 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-68154648-2d1e-4d2d-b8f0-cb7510f10da5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:58.227882 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-68154648-2d1e-4d2d-b8f0-cb7510f10da5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:58.229521 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-68154648-2d1e-4d2d-b8f0-cb7510f10da5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1737 microversion: 2.20 time: 0.782421 Jul 12 17:41:58.235404 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 185/359] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:41:57 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1737 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:41:58.474258 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-92092b44-4d4d-4d09-8d48-b5d74fc0a878 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:58.475814 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-92092b44-4d4d-4d09-8d48-b5d74fc0a878 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:58.485101 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-20b44af3-78c7-43d9-ab2b-2917c2401336 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:58.487665 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-20b44af3-78c7-43d9-ab2b-2917c2401336 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:58.499393 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-20b44af3-78c7-43d9-ab2b-2917c2401336 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:58.504056 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-20b44af3-78c7-43d9-ab2b-2917c2401336 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:58.506269 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-20b44af3-78c7-43d9-ab2b-2917c2401336 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:58.506593 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell0:SELECT=2 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:41:58.508990 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-20b44af3-78c7-43d9-ab2b-2917c2401336 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:58.509689 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-92092b44-4d4d-4d09-8d48-b5d74fc0a878 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:58.510385 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-92092b44-4d4d-4d09-8d48-b5d74fc0a878 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:58.511664 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-92092b44-4d4d-4d09-8d48-b5d74fc0a878 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:58.513167 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-92092b44-4d4d-4d09-8d48-b5d74fc0a878 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:58.722737 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell0:SELECT=8 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:41:59.066007 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-20b44af3-78c7-43d9-ab2b-2917c2401336 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:59.079570 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-20b44af3-78c7-43d9-ab2b-2917c2401336 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1368 microversion: 2.1 time: 0.613128 Jul 12 17:41:59.081046 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 175/360] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:58 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1368 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:59.087716 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-bd3c18a3-b040-4741-b155-9e4e68d313e3 req-d34b26b7-7706-47c0-8f49-2e4af7706f2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eab0c8cd-6093-440a-8e95-c58ede89a22b", "tag": "77716f74-a80f-4027-974a-c1c872d5c606"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:41:59.102498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-bd3c18a3-b040-4741-b155-9e4e68d313e3 req-d34b26b7-7706-47c0-8f49-2e4af7706f2d service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:59.103528 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-bd3c18a3-b040-4741-b155-9e4e68d313e3 req-d34b26b7-7706-47c0-8f49-2e4af7706f2d service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:59.118853 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-bd3c18a3-b040-4741-b155-9e4e68d313e3 req-d34b26b7-7706-47c0-8f49-2e4af7706f2d service nova] Creating event network-changed:77716f74-a80f-4027-974a-c1c872d5c606 for instance eab0c8cd-6093-440a-8e95-c58ede89a22b on hv-cinder-84875 Jul 12 17:41:59.132000 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-bd3c18a3-b040-4741-b155-9e4e68d313e3 req-d34b26b7-7706-47c0-8f49-2e4af7706f2d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042710 Jul 12 17:41:59.132000 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 176/361] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:41:59.193036 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-92092b44-4d4d-4d09-8d48-b5d74fc0a878 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:59.207971 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-92092b44-4d4d-4d09-8d48-b5d74fc0a878 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd" status: 200 len: 1555 microversion: 2.1 time: 0.738673 Jul 12 17:41:59.218362 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 186/362] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:58 2022] GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd => generated 1555 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:59.235928 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-c19091d5-ae06-4f4f-b22f-beb8f72ea143 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:59.235928 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-c19091d5-ae06-4f4f-b22f-beb8f72ea143 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:59.245554 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c19091d5-ae06-4f4f-b22f-beb8f72ea143 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:59.246112 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c19091d5-ae06-4f4f-b22f-beb8f72ea143 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:59.247243 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c19091d5-ae06-4f4f-b22f-beb8f72ea143 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:59.248041 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c19091d5-ae06-4f4f-b22f-beb8f72ea143 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:59.258782 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ea822785-7c7d-40fc-90d9-e8431d858ba1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:59.263263 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-ea822785-7c7d-40fc-90d9-e8431d858ba1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:59.292517 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ea822785-7c7d-40fc-90d9-e8431d858ba1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:59.303007 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ea822785-7c7d-40fc-90d9-e8431d858ba1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:59.304823 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ea822785-7c7d-40fc-90d9-e8431d858ba1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:59.305908 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ea822785-7c7d-40fc-90d9-e8431d858ba1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:59.492266 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-c19091d5-ae06-4f4f-b22f-beb8f72ea143 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.270353 Jul 12 17:41:59.497817 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 177/363] 10.222.0.16 () {58 vars in 1274 bytes} [Tue Jul 12 17:41:59 2022] GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd/os-interface => generated 285 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:41:59.934869 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-ea822785-7c7d-40fc-90d9-e8431d858ba1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:59.980384 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-ea822785-7c7d-40fc-90d9-e8431d858ba1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:59.982639 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-ea822785-7c7d-40fc-90d9-e8431d858ba1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:59.987408 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-ea822785-7c7d-40fc-90d9-e8431d858ba1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1737 microversion: 2.20 time: 0.730458 Jul 12 17:41:59.991631 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 187/364] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:41:59 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1737 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:42:00.094694 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell0:SELECT=2 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:42:00.099178 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-e2cde0ba-b528-4541-a4b3-d1d2178d494c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:00.100133 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-e2cde0ba-b528-4541-a4b3-d1d2178d494c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:00.114778 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e2cde0ba-b528-4541-a4b3-d1d2178d494c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:00.115512 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e2cde0ba-b528-4541-a4b3-d1d2178d494c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:00.116576 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e2cde0ba-b528-4541-a4b3-d1d2178d494c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:00.122841 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e2cde0ba-b528-4541-a4b3-d1d2178d494c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:00.491895 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-e2cde0ba-b528-4541-a4b3-d1d2178d494c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:00.501901 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-e2cde0ba-b528-4541-a4b3-d1d2178d494c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1368 microversion: 2.1 time: 0.407265 Jul 12 17:42:00.528500 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 178/365] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:00 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1368 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:01.009648 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-c7f21ca7-92eb-4232-87f4-24075aeff0a1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:01.011099 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-c7f21ca7-92eb-4232-87f4-24075aeff0a1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:01.031245 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c7f21ca7-92eb-4232-87f4-24075aeff0a1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:01.032360 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c7f21ca7-92eb-4232-87f4-24075aeff0a1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:01.038880 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c7f21ca7-92eb-4232-87f4-24075aeff0a1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:01.040488 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c7f21ca7-92eb-4232-87f4-24075aeff0a1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:01.537483 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-feceedcf-9fdd-4a19-9f6d-002035d5a4c6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:01.538104 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-feceedcf-9fdd-4a19-9f6d-002035d5a4c6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:01.564485 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-feceedcf-9fdd-4a19-9f6d-002035d5a4c6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:01.565486 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-feceedcf-9fdd-4a19-9f6d-002035d5a4c6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:01.566860 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-feceedcf-9fdd-4a19-9f6d-002035d5a4c6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:01.567522 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-feceedcf-9fdd-4a19-9f6d-002035d5a4c6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:01.831941 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-c7f21ca7-92eb-4232-87f4-24075aeff0a1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:01.845300 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-c7f21ca7-92eb-4232-87f4-24075aeff0a1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:01.848524 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-c7f21ca7-92eb-4232-87f4-24075aeff0a1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:01.851757 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-c7f21ca7-92eb-4232-87f4-24075aeff0a1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1737 microversion: 2.20 time: 0.847681 Jul 12 17:42:01.853685 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 188/366] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:01 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1737 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:42:02.881199 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-e0f74a87-4b19-431f-9f4e-641465da8ef8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:02.882861 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-e0f74a87-4b19-431f-9f4e-641465da8ef8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:02.919828 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e0f74a87-4b19-431f-9f4e-641465da8ef8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:02.920286 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e0f74a87-4b19-431f-9f4e-641465da8ef8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:02.934220 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-feceedcf-9fdd-4a19-9f6d-002035d5a4c6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:02.935000 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e0f74a87-4b19-431f-9f4e-641465da8ef8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:02.935000 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e0f74a87-4b19-431f-9f4e-641465da8ef8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:02.935187 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-feceedcf-9fdd-4a19-9f6d-002035d5a4c6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1368 microversion: 2.1 time: 1.400049 Jul 12 17:42:02.939904 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 179/367] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:01 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1368 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:42:02.995623 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-d33d409a-a8e7-48d3-8115-ab0600901859 req-2ccd7fa4-28b0-46ca-b7f1-15fbca939ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfbdba37-86d8-477a-95a8-9bef8b6df8dd", "tag": "7b3f7474-31df-4980-b89d-6bb57a621f7b"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:42:03.018182 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-d33d409a-a8e7-48d3-8115-ab0600901859 req-2ccd7fa4-28b0-46ca-b7f1-15fbca939ce6 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:03.018674 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-d33d409a-a8e7-48d3-8115-ab0600901859 req-2ccd7fa4-28b0-46ca-b7f1-15fbca939ce6 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:03.065190 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-d33d409a-a8e7-48d3-8115-ab0600901859 req-2ccd7fa4-28b0-46ca-b7f1-15fbca939ce6 service nova] Creating event network-changed:7b3f7474-31df-4980-b89d-6bb57a621f7b for instance dfbdba37-86d8-477a-95a8-9bef8b6df8dd on hv-cinder-84875 Jul 12 17:42:03.074481 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-d33d409a-a8e7-48d3-8115-ab0600901859 req-2ccd7fa4-28b0-46ca-b7f1-15fbca939ce6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084155 Jul 12 17:42:03.079764 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 180/368] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:42:03.288677 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-e0f74a87-4b19-431f-9f4e-641465da8ef8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:03.300164 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-e0f74a87-4b19-431f-9f4e-641465da8ef8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:03.304129 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-e0f74a87-4b19-431f-9f4e-641465da8ef8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:03.305589 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-e0f74a87-4b19-431f-9f4e-641465da8ef8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1737 microversion: 2.20 time: 0.431543 Jul 12 17:42:03.306274 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 189/369] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:02 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1737 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:42:03.959610 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-a81f2922-0b8e-497d-9d1b-fac00d19f86d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:03.960935 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-a81f2922-0b8e-497d-9d1b-fac00d19f86d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:04.017916 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a81f2922-0b8e-497d-9d1b-fac00d19f86d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:04.029900 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a81f2922-0b8e-497d-9d1b-fac00d19f86d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:04.044640 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a81f2922-0b8e-497d-9d1b-fac00d19f86d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:04.046065 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a81f2922-0b8e-497d-9d1b-fac00d19f86d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:04.339906 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-759e4a6d-84df-41cd-a23d-03f0694144ab tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:04.341010 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-759e4a6d-84df-41cd-a23d-03f0694144ab tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:04.380705 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-759e4a6d-84df-41cd-a23d-03f0694144ab tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:04.381413 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-759e4a6d-84df-41cd-a23d-03f0694144ab tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:04.392773 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-759e4a6d-84df-41cd-a23d-03f0694144ab tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:04.393582 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-759e4a6d-84df-41cd-a23d-03f0694144ab tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:04.891180 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-a81f2922-0b8e-497d-9d1b-fac00d19f86d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:04.916505 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-a81f2922-0b8e-497d-9d1b-fac00d19f86d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1368 microversion: 2.1 time: 0.966409 Jul 12 17:42:04.926004 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 181/370] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:03 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1368 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:04.926004 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-1c078268-98b2-42c5-bfa5-c70eb7029d51 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2037353484", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1463826168", "security_groups": [{"name": "tempest-secgroup-smoke-2128293980"}], "block_device_mapping_v2": [{"uuid": "866e9c31-fc60-4e0a-99e9-1e1d3f19be6f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2d0ff45d-e690-48e9-9ea7-09279c5e4d10"}]}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:42:05.170099 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-759e4a6d-84df-41cd-a23d-03f0694144ab tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:05.213202 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-759e4a6d-84df-41cd-a23d-03f0694144ab tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:05.220486 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-759e4a6d-84df-41cd-a23d-03f0694144ab tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:05.221383 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-759e4a6d-84df-41cd-a23d-03f0694144ab tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1737 microversion: 2.20 time: 0.897573 Jul 12 17:42:05.222558 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 190/371] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:04 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1737 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:42:05.338351 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.network.neutron [None req-1c078268-98b2-42c5-bfa5-c70eb7029d51 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] validate_networks() for [('2d0ff45d-e690-48e9-9ea7-09279c5e4d10', None, None, None, None, None)] {{(pid=130058) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:42:05.939209 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-4426aa14-4697-429e-8841-79b405ea9119 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:05.940019 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-4426aa14-4697-429e-8841-79b405ea9119 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:05.968572 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4426aa14-4697-429e-8841-79b405ea9119 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:05.975234 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4426aa14-4697-429e-8841-79b405ea9119 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:05.976150 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4426aa14-4697-429e-8841-79b405ea9119 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:05.982774 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4426aa14-4697-429e-8841-79b405ea9119 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:06.675464 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-4426aa14-4697-429e-8841-79b405ea9119 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:06.689428 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-4426aa14-4697-429e-8841-79b405ea9119 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1368 microversion: 2.1 time: 0.755620 Jul 12 17:42:06.690397 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 191/372] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:05 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1368 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:06.709630 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-e8b9cb1b-d084-4954-9686-0f9a141ca07d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:06.713158 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-e8b9cb1b-d084-4954-9686-0f9a141ca07d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:06.731413 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e8b9cb1b-d084-4954-9686-0f9a141ca07d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:06.735589 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e8b9cb1b-d084-4954-9686-0f9a141ca07d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:06.737412 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e8b9cb1b-d084-4954-9686-0f9a141ca07d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:06.740109 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e8b9cb1b-d084-4954-9686-0f9a141ca07d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:07.361963 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-1c078268-98b2-42c5-bfa5-c70eb7029d51 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Flavor limits 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:42:07.363530 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-1c078268-98b2-42c5-bfa5-c70eb7029d51 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Image limits 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:42:07.364739 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-1c078268-98b2-42c5-bfa5-c70eb7029d51 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Flavor pref 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:42:07.365703 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-1c078268-98b2-42c5-bfa5-c70eb7029d51 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Image pref 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:42:07.366891 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-1c078268-98b2-42c5-bfa5-c70eb7029d51 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:42:07.394327 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-e8b9cb1b-d084-4954-9686-0f9a141ca07d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:07.420084 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1c078268-98b2-42c5-bfa5-c70eb7029d51 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:07.423281 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1c078268-98b2-42c5-bfa5-c70eb7029d51 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:07.430704 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1c078268-98b2-42c5-bfa5-c70eb7029d51 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:07.435009 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1c078268-98b2-42c5-bfa5-c70eb7029d51 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:07.503616 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-e8b9cb1b-d084-4954-9686-0f9a141ca07d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:07.506033 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-e8b9cb1b-d084-4954-9686-0f9a141ca07d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:07.512708 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-1c078268-98b2-42c5-bfa5-c70eb7029d51 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Getting quotas for project e4b2b488b746454b9f93d67fa3c97809. Resources: {'cores', 'instances', 'ram'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:42:07.526597 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-1c078268-98b2-42c5-bfa5-c70eb7029d51 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Getting quotas for user bde6ee9df10146d98991b0d4bb37fc48 and project e4b2b488b746454b9f93d67fa3c97809. Resources: {'cores', 'instances', 'ram'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:42:07.526851 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-e8b9cb1b-d084-4954-9686-0f9a141ca07d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1737 microversion: 2.20 time: 0.825618 Jul 12 17:42:07.538928 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 192/373] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:06 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1737 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:42:07.713186 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-b0eaae5c-7c1b-4b89-ae83-b4cb452a33d6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:07.716865 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-1c078268-98b2-42c5-bfa5-c70eb7029d51 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Going to run 1 instances... {{(pid=130058) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:42:07.717167 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-b0eaae5c-7c1b-4b89-ae83-b4cb452a33d6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:07.724391 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-1c078268-98b2-42c5-bfa5-c70eb7029d51 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='866e9c31-fc60-4e0a-99e9-1e1d3f19be6f',volume_size=None,volume_type=None)] {{(pid=130058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:42:07.757703 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b0eaae5c-7c1b-4b89-ae83-b4cb452a33d6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:07.759492 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b0eaae5c-7c1b-4b89-ae83-b4cb452a33d6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:07.762413 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b0eaae5c-7c1b-4b89-ae83-b4cb452a33d6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:07.763495 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b0eaae5c-7c1b-4b89-ae83-b4cb452a33d6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:08.489395 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-b0eaae5c-7c1b-4b89-ae83-b4cb452a33d6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:08.520692 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=100 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:42:08.526268 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-b0eaae5c-7c1b-4b89-ae83-b4cb452a33d6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1368 microversion: 2.1 time: 0.822434 Jul 12 17:42:08.528341 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 193/374] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:07 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1368 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:08.581285 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-d57ff0f9-226e-42c5-9aab-a0d438f6b202 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:08.584006 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-d57ff0f9-226e-42c5-9aab-a0d438f6b202 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:08.620182 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d57ff0f9-226e-42c5-9aab-a0d438f6b202 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:08.621040 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d57ff0f9-226e-42c5-9aab-a0d438f6b202 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:08.629203 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d57ff0f9-226e-42c5-9aab-a0d438f6b202 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:08.630054 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d57ff0f9-226e-42c5-9aab-a0d438f6b202 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:08.802920 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-1c078268-98b2-42c5-bfa5-c70eb7029d51 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.884126 Jul 12 17:42:08.804864 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 182/375] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 12 17:42:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 3887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:42:08.823133 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-55491f53-a3f9-480e-963c-0a6efb0af68d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:08.826030 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-55491f53-a3f9-480e-963c-0a6efb0af68d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:09.138815 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-d57ff0f9-226e-42c5-9aab-a0d438f6b202 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:09.177900 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-d57ff0f9-226e-42c5-9aab-a0d438f6b202 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:09.189863 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-d57ff0f9-226e-42c5-9aab-a0d438f6b202 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:09.197688 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-d57ff0f9-226e-42c5-9aab-a0d438f6b202 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1737 microversion: 2.20 time: 0.642737 Jul 12 17:42:09.201143 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 194/376] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:08 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1737 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:42:09.399569 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-55491f53-a3f9-480e-963c-0a6efb0af68d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:09.408772 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-55491f53-a3f9-480e-963c-0a6efb0af68d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1095 microversion: 2.1 time: 0.597398 Jul 12 17:42:09.410950 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 183/377] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:08 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1095 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:09.544994 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-cc32f7b8-f16a-416b-b91d-c4b48a0f8c1e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:09.545800 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-cc32f7b8-f16a-416b-b91d-c4b48a0f8c1e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:09.568624 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:42:09.571915 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cc32f7b8-f16a-416b-b91d-c4b48a0f8c1e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:09.572677 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cc32f7b8-f16a-416b-b91d-c4b48a0f8c1e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:09.573812 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cc32f7b8-f16a-416b-b91d-c4b48a0f8c1e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:09.574463 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cc32f7b8-f16a-416b-b91d-c4b48a0f8c1e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:09.937171 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-cc32f7b8-f16a-416b-b91d-c4b48a0f8c1e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:09.950271 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-cc32f7b8-f16a-416b-b91d-c4b48a0f8c1e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1368 microversion: 2.1 time: 0.406341 Jul 12 17:42:09.958244 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 195/378] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:09 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1368 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:42:10.223180 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-6217bf4d-1cb4-4834-ac94-2a86be0cff2f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:10.223755 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-6217bf4d-1cb4-4834-ac94-2a86be0cff2f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:10.231014 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6217bf4d-1cb4-4834-ac94-2a86be0cff2f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:10.231835 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6217bf4d-1cb4-4834-ac94-2a86be0cff2f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:10.233157 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6217bf4d-1cb4-4834-ac94-2a86be0cff2f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:10.233938 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6217bf4d-1cb4-4834-ac94-2a86be0cff2f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:10.449505 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-efc58738-8d18-48a2-8b33-eedd5ec2c0ce tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:10.451629 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-efc58738-8d18-48a2-8b33-eedd5ec2c0ce tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:10.558199 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-efc58738-8d18-48a2-8b33-eedd5ec2c0ce tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:10.580660 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-efc58738-8d18-48a2-8b33-eedd5ec2c0ce tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1095 microversion: 2.1 time: 0.143785 Jul 12 17:42:10.581583 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 196/379] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:10 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1095 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:10.636642 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-6217bf4d-1cb4-4834-ac94-2a86be0cff2f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:10.658126 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-6217bf4d-1cb4-4834-ac94-2a86be0cff2f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:10.662841 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-6217bf4d-1cb4-4834-ac94-2a86be0cff2f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:10.665950 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-6217bf4d-1cb4-4834-ac94-2a86be0cff2f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1737 microversion: 2.20 time: 0.447939 Jul 12 17:42:10.681012 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 184/380] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:10 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1737 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:42:10.970377 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-716068cc-b327-4a70-bf6e-5bbcff2e49b4 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:10.971416 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-716068cc-b327-4a70-bf6e-5bbcff2e49b4 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:11.000539 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-716068cc-b327-4a70-bf6e-5bbcff2e49b4 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:11.001374 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-716068cc-b327-4a70-bf6e-5bbcff2e49b4 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:11.005366 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-716068cc-b327-4a70-bf6e-5bbcff2e49b4 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:11.021500 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-716068cc-b327-4a70-bf6e-5bbcff2e49b4 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:11.336884 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-716068cc-b327-4a70-bf6e-5bbcff2e49b4 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:11.350367 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-716068cc-b327-4a70-bf6e-5bbcff2e49b4 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1368 microversion: 2.1 time: 0.388697 Jul 12 17:42:11.356669 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 197/381] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:10 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1368 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:11.619361 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-26dfc05f-1fe3-479a-b165-6a708ca797d7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:11.620032 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-26dfc05f-1fe3-479a-b165-6a708ca797d7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:11.634917 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-26dfc05f-1fe3-479a-b165-6a708ca797d7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:11.635632 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-26dfc05f-1fe3-479a-b165-6a708ca797d7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:11.636599 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-26dfc05f-1fe3-479a-b165-6a708ca797d7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:11.637195 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-26dfc05f-1fe3-479a-b165-6a708ca797d7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:11.685716 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-5ede9d24-d0f3-4af4-b19f-bcaf754b31d5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:11.687114 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-5ede9d24-d0f3-4af4-b19f-bcaf754b31d5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:11.695821 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5ede9d24-d0f3-4af4-b19f-bcaf754b31d5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:11.697377 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5ede9d24-d0f3-4af4-b19f-bcaf754b31d5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:11.698594 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5ede9d24-d0f3-4af4-b19f-bcaf754b31d5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:11.699290 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5ede9d24-d0f3-4af4-b19f-bcaf754b31d5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:11.768235 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-26dfc05f-1fe3-479a-b165-6a708ca797d7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:11.776697 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-26dfc05f-1fe3-479a-b165-6a708ca797d7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1145 microversion: 2.1 time: 0.161186 Jul 12 17:42:11.788334 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 185/382] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:11 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1145 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:11.842819 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-1f9930b8-22d5-4341-b8cb-44d7955bd997 req-5468495f-9385-473e-83ed-f64ec8cb1fcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eab0c8cd-6093-440a-8e95-c58ede89a22b", "name": "network-vif-plugged", "status": "completed", "tag": "77716f74-a80f-4027-974a-c1c872d5c606"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:42:11.856184 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-1f9930b8-22d5-4341-b8cb-44d7955bd997 req-5468495f-9385-473e-83ed-f64ec8cb1fcd service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:11.856184 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-1f9930b8-22d5-4341-b8cb-44d7955bd997 req-5468495f-9385-473e-83ed-f64ec8cb1fcd service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:11.867558 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-1f9930b8-22d5-4341-b8cb-44d7955bd997 req-5468495f-9385-473e-83ed-f64ec8cb1fcd service nova] Creating event network-vif-plugged:77716f74-a80f-4027-974a-c1c872d5c606 for instance eab0c8cd-6093-440a-8e95-c58ede89a22b on hv-cinder-84875 Jul 12 17:42:11.873918 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-1f9930b8-22d5-4341-b8cb-44d7955bd997 req-5468495f-9385-473e-83ed-f64ec8cb1fcd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035105 Jul 12 17:42:11.874630 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 186/383] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:42:11.957859 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-5ede9d24-d0f3-4af4-b19f-bcaf754b31d5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:11.957859 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-5ede9d24-d0f3-4af4-b19f-bcaf754b31d5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:11.958908 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-5ede9d24-d0f3-4af4-b19f-bcaf754b31d5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:11.962823 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-5ede9d24-d0f3-4af4-b19f-bcaf754b31d5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1737 microversion: 2.20 time: 0.276744 Jul 12 17:42:11.976386 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 198/384] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:11 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1737 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:42:12.368632 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-2b7b4901-938d-4619-ad81-aa897d9307ca tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:12.375348 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-2b7b4901-938d-4619-ad81-aa897d9307ca tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:12.401255 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2b7b4901-938d-4619-ad81-aa897d9307ca tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:12.407874 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2b7b4901-938d-4619-ad81-aa897d9307ca tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:12.413771 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2b7b4901-938d-4619-ad81-aa897d9307ca tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:12.418201 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2b7b4901-938d-4619-ad81-aa897d9307ca tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:12.796480 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-f0a0762c-da2f-4387-9223-1be5032d16d3 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:12.797293 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-f0a0762c-da2f-4387-9223-1be5032d16d3 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:12.820658 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f0a0762c-da2f-4387-9223-1be5032d16d3 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:12.821730 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f0a0762c-da2f-4387-9223-1be5032d16d3 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:12.826745 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f0a0762c-da2f-4387-9223-1be5032d16d3 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:12.827511 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f0a0762c-da2f-4387-9223-1be5032d16d3 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:13.017518 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-f0a0762c-da2f-4387-9223-1be5032d16d3 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:13.029208 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-f0a0762c-da2f-4387-9223-1be5032d16d3 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1193 microversion: 2.1 time: 0.237425 Jul 12 17:42:13.034657 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 199/385] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:12 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1193 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:42:13.051612 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a5de107a-1ad1-47de-ac9a-ed46ffba9248 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:13.054353 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-a5de107a-1ad1-47de-ac9a-ed46ffba9248 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:13.080123 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a5de107a-1ad1-47de-ac9a-ed46ffba9248 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:13.080123 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a5de107a-1ad1-47de-ac9a-ed46ffba9248 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:13.080123 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a5de107a-1ad1-47de-ac9a-ed46ffba9248 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:13.080123 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a5de107a-1ad1-47de-ac9a-ed46ffba9248 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:13.543730 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a5de107a-1ad1-47de-ac9a-ed46ffba9248 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:13.559045 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a5de107a-1ad1-47de-ac9a-ed46ffba9248 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:13.580713 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-2b7b4901-938d-4619-ad81-aa897d9307ca tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:13.581477 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a5de107a-1ad1-47de-ac9a-ed46ffba9248 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:13.583875 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-a5de107a-1ad1-47de-ac9a-ed46ffba9248 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1737 microversion: 2.20 time: 0.549255 Jul 12 17:42:13.587155 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 200/386] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:13 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1737 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:42:13.595555 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-2b7b4901-938d-4619-ad81-aa897d9307ca tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1368 microversion: 2.1 time: 1.231399 Jul 12 17:42:13.598291 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 187/387] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:12 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1368 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:14.053849 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-2a108353-ab0f-4919-ac8b-a56c8265d5a5 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:14.055300 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-2a108353-ab0f-4919-ac8b-a56c8265d5a5 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:14.072818 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2a108353-ab0f-4919-ac8b-a56c8265d5a5 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:14.073279 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2a108353-ab0f-4919-ac8b-a56c8265d5a5 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:14.075970 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2a108353-ab0f-4919-ac8b-a56c8265d5a5 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:14.075970 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2a108353-ab0f-4919-ac8b-a56c8265d5a5 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:14.359187 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-2a108353-ab0f-4919-ac8b-a56c8265d5a5 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:14.367933 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-2a108353-ab0f-4919-ac8b-a56c8265d5a5 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1201 microversion: 2.1 time: 0.322403 Jul 12 17:42:14.368879 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 201/388] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:14 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1201 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:14.607793 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-480430f8-2483-4638-af00-fd022c064bb1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:14.608598 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-480430f8-2483-4638-af00-fd022c064bb1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:14.622073 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-c5c085ec-ffdc-4053-9d7d-2c39fd69be77 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:14.622073 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-c5c085ec-ffdc-4053-9d7d-2c39fd69be77 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:14.654144 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c5c085ec-ffdc-4053-9d7d-2c39fd69be77 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:14.661012 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-480430f8-2483-4638-af00-fd022c064bb1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:14.665363 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-480430f8-2483-4638-af00-fd022c064bb1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:14.666287 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c5c085ec-ffdc-4053-9d7d-2c39fd69be77 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:14.667305 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c5c085ec-ffdc-4053-9d7d-2c39fd69be77 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:14.667773 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c5c085ec-ffdc-4053-9d7d-2c39fd69be77 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:14.670054 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-480430f8-2483-4638-af00-fd022c064bb1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:14.670905 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-480430f8-2483-4638-af00-fd022c064bb1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:15.129789 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-c5c085ec-ffdc-4053-9d7d-2c39fd69be77 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:15.144945 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-c5c085ec-ffdc-4053-9d7d-2c39fd69be77 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1368 microversion: 2.1 time: 0.534420 Jul 12 17:42:15.168162 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 202/389] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:14 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1368 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:42:15.396825 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-926b2886-6d34-42db-8d10-1b54c43c1028 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:15.396825 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-926b2886-6d34-42db-8d10-1b54c43c1028 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:15.414056 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-926b2886-6d34-42db-8d10-1b54c43c1028 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:15.415011 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-926b2886-6d34-42db-8d10-1b54c43c1028 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:15.416038 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-926b2886-6d34-42db-8d10-1b54c43c1028 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:15.416644 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-926b2886-6d34-42db-8d10-1b54c43c1028 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:15.554603 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-926b2886-6d34-42db-8d10-1b54c43c1028 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:15.571378 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-480430f8-2483-4638-af00-fd022c064bb1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:15.577560 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-926b2886-6d34-42db-8d10-1b54c43c1028 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1211 microversion: 2.1 time: 0.188995 Jul 12 17:42:15.593633 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 203/390] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:15 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1211 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:15.599387 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-480430f8-2483-4638-af00-fd022c064bb1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:15.602285 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-480430f8-2483-4638-af00-fd022c064bb1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:15.604440 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-480430f8-2483-4638-af00-fd022c064bb1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1737 microversion: 2.20 time: 1.001245 Jul 12 17:42:15.618636 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 188/391] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:14 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1737 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:42:16.169539 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-7ef9892b-cc03-44ae-8a13-c52e70fc69d2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:16.178282 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-7ef9892b-cc03-44ae-8a13-c52e70fc69d2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:16.189063 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7ef9892b-cc03-44ae-8a13-c52e70fc69d2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:16.189962 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7ef9892b-cc03-44ae-8a13-c52e70fc69d2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:16.191131 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7ef9892b-cc03-44ae-8a13-c52e70fc69d2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:16.192139 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7ef9892b-cc03-44ae-8a13-c52e70fc69d2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:16.462537 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-7ef9892b-cc03-44ae-8a13-c52e70fc69d2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:16.473530 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-7ef9892b-cc03-44ae-8a13-c52e70fc69d2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1561 microversion: 2.1 time: 0.310930 Jul 12 17:42:16.474180 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 204/392] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:16 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1561 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:16.492823 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-8707f64d-c50f-4dd5-8cf0-54fa0423ac8d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:16.493328 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-8707f64d-c50f-4dd5-8cf0-54fa0423ac8d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:16.500049 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8707f64d-c50f-4dd5-8cf0-54fa0423ac8d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:16.500836 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8707f64d-c50f-4dd5-8cf0-54fa0423ac8d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:16.501815 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8707f64d-c50f-4dd5-8cf0-54fa0423ac8d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:16.502450 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8707f64d-c50f-4dd5-8cf0-54fa0423ac8d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:16.607584 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-9ad3fb6b-e7e9-4599-826d-f9e3812dd6d4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:16.607802 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-9ad3fb6b-e7e9-4599-826d-f9e3812dd6d4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:16.624003 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9ad3fb6b-e7e9-4599-826d-f9e3812dd6d4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:16.631623 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9ad3fb6b-e7e9-4599-826d-f9e3812dd6d4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:16.635176 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9ad3fb6b-e7e9-4599-826d-f9e3812dd6d4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:16.638231 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9ad3fb6b-e7e9-4599-826d-f9e3812dd6d4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:16.992522 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-8707f64d-c50f-4dd5-8cf0-54fa0423ac8d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.503154 Jul 12 17:42:17.004590 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-9ad3fb6b-e7e9-4599-826d-f9e3812dd6d4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:17.006607 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 189/393] 10.222.0.16 () {58 vars in 1274 bytes} [Tue Jul 12 17:42:16 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b/os-interface => generated 284 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:42:17.017520 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-938590f6-1e25-4bcb-9ced-03b6302a1a45 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:17.019395 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-938590f6-1e25-4bcb-9ced-03b6302a1a45 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:17.020802 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-9ad3fb6b-e7e9-4599-826d-f9e3812dd6d4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1279 microversion: 2.1 time: 0.418886 Jul 12 17:42:17.030785 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 205/394] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:16 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1279 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:17.053159 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-938590f6-1e25-4bcb-9ced-03b6302a1a45 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:17.054628 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-938590f6-1e25-4bcb-9ced-03b6302a1a45 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:17.056514 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-938590f6-1e25-4bcb-9ced-03b6302a1a45 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:17.057694 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-938590f6-1e25-4bcb-9ced-03b6302a1a45 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:17.469587 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell0:SELECT=2 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:42:17.774962 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-938590f6-1e25-4bcb-9ced-03b6302a1a45 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:17.784035 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-938590f6-1e25-4bcb-9ced-03b6302a1a45 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:17.785909 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-938590f6-1e25-4bcb-9ced-03b6302a1a45 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:17.792383 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-938590f6-1e25-4bcb-9ced-03b6302a1a45 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1719 microversion: 2.20 time: 0.778482 Jul 12 17:42:17.792383 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 190/395] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:17 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1719 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:42:18.062042 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-c33c9fa7-27af-4286-a50b-7ec5335a3d6d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:18.063231 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-c33c9fa7-27af-4286-a50b-7ec5335a3d6d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:18.090936 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c33c9fa7-27af-4286-a50b-7ec5335a3d6d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:18.092225 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c33c9fa7-27af-4286-a50b-7ec5335a3d6d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:18.095559 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c33c9fa7-27af-4286-a50b-7ec5335a3d6d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:18.096668 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c33c9fa7-27af-4286-a50b-7ec5335a3d6d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:18.802365 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-c33c9fa7-27af-4286-a50b-7ec5335a3d6d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:18.811450 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-802cdd5f-2fbf-41d2-b2f7-5466f2389733 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:18.811450 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-802cdd5f-2fbf-41d2-b2f7-5466f2389733 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:18.826178 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-802cdd5f-2fbf-41d2-b2f7-5466f2389733 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:18.826727 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-802cdd5f-2fbf-41d2-b2f7-5466f2389733 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:18.829673 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-c33c9fa7-27af-4286-a50b-7ec5335a3d6d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1267 microversion: 2.1 time: 0.786854 Jul 12 17:42:18.830165 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-802cdd5f-2fbf-41d2-b2f7-5466f2389733 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:18.830925 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-802cdd5f-2fbf-41d2-b2f7-5466f2389733 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:18.831707 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 206/396] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:18 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1267 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:19.386680 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-8baf50c2-0442-4b95-93e8-203be75e091a req-c43fffba-fd74-4d3c-b09f-84eedb533e59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eab0c8cd-6093-440a-8e95-c58ede89a22b", "tag": "77716f74-a80f-4027-974a-c1c872d5c606"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:42:19.403736 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-8baf50c2-0442-4b95-93e8-203be75e091a req-c43fffba-fd74-4d3c-b09f-84eedb533e59 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:19.404368 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-8baf50c2-0442-4b95-93e8-203be75e091a req-c43fffba-fd74-4d3c-b09f-84eedb533e59 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:19.406887 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell0:SELECT=8 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:42:19.435161 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-8baf50c2-0442-4b95-93e8-203be75e091a req-c43fffba-fd74-4d3c-b09f-84eedb533e59 service nova] Creating event network-changed:77716f74-a80f-4027-974a-c1c872d5c606 for instance eab0c8cd-6093-440a-8e95-c58ede89a22b on hv-cinder-84875 Jul 12 17:42:19.448227 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-8baf50c2-0442-4b95-93e8-203be75e091a req-c43fffba-fd74-4d3c-b09f-84eedb533e59 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071700 Jul 12 17:42:19.462352 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 207/397] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:42:19.479065 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-802cdd5f-2fbf-41d2-b2f7-5466f2389733 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:19.526652 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-802cdd5f-2fbf-41d2-b2f7-5466f2389733 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:19.539388 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-802cdd5f-2fbf-41d2-b2f7-5466f2389733 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:19.551807 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-802cdd5f-2fbf-41d2-b2f7-5466f2389733 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1719 microversion: 2.20 time: 0.746122 Jul 12 17:42:19.556630 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 191/398] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:18 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1719 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:42:19.592012 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-f20be69c-5d46-4fc5-8fd6-19619c945743 req-37614524-b530-4861-b05b-4c87f14301a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f88418d-5f96-4c05-adf4-09d83f045699", "name": "network-vif-unplugged", "status": "completed", "tag": "082490a4-d27d-40c5-93fa-92a28b71e068"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:42:19.604824 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-f20be69c-5d46-4fc5-8fd6-19619c945743 req-37614524-b530-4861-b05b-4c87f14301a0 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:19.605610 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-f20be69c-5d46-4fc5-8fd6-19619c945743 req-37614524-b530-4861-b05b-4c87f14301a0 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:19.625897 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-f20be69c-5d46-4fc5-8fd6-19619c945743 req-37614524-b530-4861-b05b-4c87f14301a0 service nova] Creating event network-vif-unplugged:082490a4-d27d-40c5-93fa-92a28b71e068 for instance 7f88418d-5f96-4c05-adf4-09d83f045699 on hv-cinder-84875 Jul 12 17:42:19.632612 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-f20be69c-5d46-4fc5-8fd6-19619c945743 req-37614524-b530-4861-b05b-4c87f14301a0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048016 Jul 12 17:42:19.633531 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 208/399] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:42:19.866313 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-ae4079b8-921c-4e7e-8771-82840dd9cfb1 req-7b16af55-3ee0-4ef1-9e45-5855a9710286 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73d03675-d5c4-4778-a9c2-320d010588b7", "tag": "9dd6e257-1f75-4cdb-b508-53b460481a96"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:42:19.873432 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-dd96cf5a-f3ee-4d56-8f55-187af25e8be6 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:19.877749 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-dd96cf5a-f3ee-4d56-8f55-187af25e8be6 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:19.892395 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-ae4079b8-921c-4e7e-8771-82840dd9cfb1 req-7b16af55-3ee0-4ef1-9e45-5855a9710286 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:19.892872 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-ae4079b8-921c-4e7e-8771-82840dd9cfb1 req-7b16af55-3ee0-4ef1-9e45-5855a9710286 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:19.933647 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-ae4079b8-921c-4e7e-8771-82840dd9cfb1 req-7b16af55-3ee0-4ef1-9e45-5855a9710286 service nova] Creating event network-changed:9dd6e257-1f75-4cdb-b508-53b460481a96 for instance 73d03675-d5c4-4778-a9c2-320d010588b7 on hv-cinder-84875 Jul 12 17:42:19.935590 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-dd96cf5a-f3ee-4d56-8f55-187af25e8be6 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:19.936458 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-dd96cf5a-f3ee-4d56-8f55-187af25e8be6 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:19.942205 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-dd96cf5a-f3ee-4d56-8f55-187af25e8be6 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:19.944840 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-dd96cf5a-f3ee-4d56-8f55-187af25e8be6 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:19.959696 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-ae4079b8-921c-4e7e-8771-82840dd9cfb1 req-7b16af55-3ee0-4ef1-9e45-5855a9710286 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097786 Jul 12 17:42:19.960580 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 209/400] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:42:20.592268 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a862b605-19db-4bce-8531-69e332a46d84 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:20.593738 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-a862b605-19db-4bce-8531-69e332a46d84 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:20.604243 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell0:SELECT=2 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:42:20.608523 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a862b605-19db-4bce-8531-69e332a46d84 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:20.609680 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a862b605-19db-4bce-8531-69e332a46d84 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:20.612202 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a862b605-19db-4bce-8531-69e332a46d84 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:20.613446 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a862b605-19db-4bce-8531-69e332a46d84 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:20.901861 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a862b605-19db-4bce-8531-69e332a46d84 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:20.913327 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a862b605-19db-4bce-8531-69e332a46d84 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:20.915911 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a862b605-19db-4bce-8531-69e332a46d84 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:20.917896 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-a862b605-19db-4bce-8531-69e332a46d84 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1719 microversion: 2.20 time: 0.343836 Jul 12 17:42:20.920603 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 210/401] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:20 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1719 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:42:20.961957 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-dd96cf5a-f3ee-4d56-8f55-187af25e8be6 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:20.974577 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-dd96cf5a-f3ee-4d56-8f55-187af25e8be6 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1267 microversion: 2.1 time: 1.129040 Jul 12 17:42:20.984895 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 192/402] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:19 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1267 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:21.946753 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-5d205762-6600-4b87-8776-762a54410b5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:21.948742 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-5d205762-6600-4b87-8776-762a54410b5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:21.971705 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5d205762-6600-4b87-8776-762a54410b5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:21.975319 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5d205762-6600-4b87-8776-762a54410b5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:21.978737 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5d205762-6600-4b87-8776-762a54410b5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:21.982885 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5d205762-6600-4b87-8776-762a54410b5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:22.006646 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b78c081e-5240-4d9b-bb68-4ddd9b6c0b38 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:22.008394 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-b78c081e-5240-4d9b-bb68-4ddd9b6c0b38 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:22.036645 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:42:22.039557 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b78c081e-5240-4d9b-bb68-4ddd9b6c0b38 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:22.041091 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b78c081e-5240-4d9b-bb68-4ddd9b6c0b38 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:22.042897 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b78c081e-5240-4d9b-bb68-4ddd9b6c0b38 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:22.044263 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b78c081e-5240-4d9b-bb68-4ddd9b6c0b38 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:22.407780 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-5d205762-6600-4b87-8776-762a54410b5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:22.421464 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-5d205762-6600-4b87-8776-762a54410b5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:22.426782 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-5d205762-6600-4b87-8776-762a54410b5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:22.428559 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-5d205762-6600-4b87-8776-762a54410b5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1722 microversion: 2.20 time: 0.491557 Jul 12 17:42:22.431204 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 211/403] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:21 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1722 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:42:22.468408 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-5126bf3f-396d-4adc-9afb-c8fc6ce119d0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9d164eb-0a27-4384-b031-2ceb13658fca"}} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:42:22.470566 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-5126bf3f-396d-4adc-9afb-c8fc6ce119d0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:22.484688 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5126bf3f-396d-4adc-9afb-c8fc6ce119d0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:22.490543 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5126bf3f-396d-4adc-9afb-c8fc6ce119d0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:22.491762 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5126bf3f-396d-4adc-9afb-c8fc6ce119d0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:22.492233 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5126bf3f-396d-4adc-9afb-c8fc6ce119d0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:22.633121 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-b78c081e-5240-4d9b-bb68-4ddd9b6c0b38 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:22.661177 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-b78c081e-5240-4d9b-bb68-4ddd9b6c0b38 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1267 microversion: 2.1 time: 0.659741 Jul 12 17:42:22.671795 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 193/404] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:21 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1267 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:23.260647 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:42:23.606941 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-fafc4af3-39e3-4dd6-857f-30bf761e4774 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-341886910", "imageRef": "cb077f42-97cd-41cf-8758-764c562534f4", "flavorRef": "452"}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:42:23.679710 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.network.neutron [None req-fafc4af3-39e3-4dd6-857f-30bf761e4774 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] validate_networks() for None {{(pid=130058) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:42:24.200951 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-5126bf3f-396d-4adc-9afb-c8fc6ce119d0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "POST /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.737690 Jul 12 17:42:24.211516 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 212/405] 10.222.0.16 () {62 vars in 1363 bytes} [Tue Jul 12 17:42:22 2022] POST /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699/os-volume_attachments => generated 188 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 17:42:24.211516 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-358fe342-941f-4fb3-805c-965c37f2f57f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:24.211940 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-358fe342-941f-4fb3-805c-965c37f2f57f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:24.221954 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-358fe342-941f-4fb3-805c-965c37f2f57f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:24.222541 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-358fe342-941f-4fb3-805c-965c37f2f57f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:24.223462 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-358fe342-941f-4fb3-805c-965c37f2f57f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:24.224944 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-358fe342-941f-4fb3-805c-965c37f2f57f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:24.408958 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-358fe342-941f-4fb3-805c-965c37f2f57f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:24.418944 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-358fe342-941f-4fb3-805c-965c37f2f57f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1267 microversion: 2.1 time: 0.215961 Jul 12 17:42:24.419840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 213/406] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:24 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1267 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:24.470261 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-63a21eba-4786-46a0-8dba-861b912bf9e4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:42:24.470754 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-63a21eba-4786-46a0-8dba-861b912bf9e4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:24.478135 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-63a21eba-4786-46a0-8dba-861b912bf9e4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:24.478626 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-63a21eba-4786-46a0-8dba-861b912bf9e4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:24.479493 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-63a21eba-4786-46a0-8dba-861b912bf9e4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:24.479936 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-63a21eba-4786-46a0-8dba-861b912bf9e4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:24.508759 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-fafc4af3-39e3-4dd6-857f-30bf761e4774 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Flavor limits 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:42:24.509432 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-fafc4af3-39e3-4dd6-857f-30bf761e4774 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Image limits 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:42:24.510091 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-fafc4af3-39e3-4dd6-857f-30bf761e4774 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Flavor pref 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:42:24.510618 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-fafc4af3-39e3-4dd6-857f-30bf761e4774 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Image pref 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:42:24.511124 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-fafc4af3-39e3-4dd6-857f-30bf761e4774 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:42:24.526622 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fafc4af3-39e3-4dd6-857f-30bf761e4774 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:24.527520 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fafc4af3-39e3-4dd6-857f-30bf761e4774 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:24.529416 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fafc4af3-39e3-4dd6-857f-30bf761e4774 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:24.530313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fafc4af3-39e3-4dd6-857f-30bf761e4774 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:24.571159 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-fafc4af3-39e3-4dd6-857f-30bf761e4774 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Getting quotas for project 019d9f28339c4316bb3cda3e4c6ea908. Resources: {'cores', 'instances', 'ram'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:42:24.586580 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-fafc4af3-39e3-4dd6-857f-30bf761e4774 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Getting quotas for user 7b076f0335184c22a2aa07bf484c631e and project 019d9f28339c4316bb3cda3e4c6ea908. Resources: {'cores', 'instances', 'ram'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:42:24.615863 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-fafc4af3-39e3-4dd6-857f-30bf761e4774 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Going to run 1 instances... {{(pid=130058) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:42:24.619288 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-fafc4af3-39e3-4dd6-857f-30bf761e4774 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb077f42-97cd-41cf-8758-764c562534f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:42:25.041281 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-fafc4af3-39e3-4dd6-857f-30bf761e4774 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.440270 Jul 12 17:42:25.042461 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 194/407] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 12 17:42:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 17:42:25.053793 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-4e6cd42f-a24d-4ddb-b7d4-76d34c8b10aa tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:25.056072 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-4e6cd42f-a24d-4ddb-b7d4-76d34c8b10aa tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:25.103399 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-63a21eba-4786-46a0-8dba-861b912bf9e4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "POST /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699/action" status: 202 len: 0 microversion: 2.20 time: 0.639126 Jul 12 17:42:25.104039 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 214/408] 10.222.0.16 () {62 vars in 1318 bytes} [Tue Jul 12 17:42:24 2022] POST /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699/action => generated 0 bytes in 641 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 12 17:42:25.120165 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-e3dc231d-de06-46ab-93a6-1edffd4bea06 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:25.122676 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-e3dc231d-de06-46ab-93a6-1edffd4bea06 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:25.137507 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e3dc231d-de06-46ab-93a6-1edffd4bea06 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:25.138018 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e3dc231d-de06-46ab-93a6-1edffd4bea06 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:25.139049 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e3dc231d-de06-46ab-93a6-1edffd4bea06 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:25.139499 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e3dc231d-de06-46ab-93a6-1edffd4bea06 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:25.195134 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-4e6cd42f-a24d-4ddb-b7d4-76d34c8b10aa tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:25.240770 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-4e6cd42f-a24d-4ddb-b7d4-76d34c8b10aa tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1214 microversion: 2.1 time: 0.160075 Jul 12 17:42:25.243086 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 195/409] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:25 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1214 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:42:25.432005 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-e3dc231d-de06-46ab-93a6-1edffd4bea06 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:25.446913 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-e3dc231d-de06-46ab-93a6-1edffd4bea06 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:25.452842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-e3dc231d-de06-46ab-93a6-1edffd4bea06 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:25.455686 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-177f8c9a-5ce5-4653-82ca-48c06c223296 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:25.455913 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-e3dc231d-de06-46ab-93a6-1edffd4bea06 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1748 microversion: 2.20 time: 0.346861 Jul 12 17:42:25.459424 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-177f8c9a-5ce5-4653-82ca-48c06c223296 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:25.470597 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 215/410] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:25 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1748 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:42:25.484061 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-177f8c9a-5ce5-4653-82ca-48c06c223296 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:25.498827 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-177f8c9a-5ce5-4653-82ca-48c06c223296 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:25.498827 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-177f8c9a-5ce5-4653-82ca-48c06c223296 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:25.500679 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-177f8c9a-5ce5-4653-82ca-48c06c223296 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:25.817733 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-177f8c9a-5ce5-4653-82ca-48c06c223296 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:25.831875 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-177f8c9a-5ce5-4653-82ca-48c06c223296 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1267 microversion: 2.1 time: 0.384604 Jul 12 17:42:25.833431 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 196/411] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:25 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1267 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:26.257983 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-fdc135ab-8520-487a-ad81-c5f7fafc83a7 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:26.258803 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-fdc135ab-8520-487a-ad81-c5f7fafc83a7 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:26.370838 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-fdc135ab-8520-487a-ad81-c5f7fafc83a7 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:26.387869 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-fdc135ab-8520-487a-ad81-c5f7fafc83a7 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1214 microversion: 2.1 time: 0.133657 Jul 12 17:42:26.394018 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 216/412] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:26 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1214 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:26.496308 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-0eb9cccd-c6bd-4100-ba0f-ab18038d029d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:26.497266 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-0eb9cccd-c6bd-4100-ba0f-ab18038d029d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:26.516004 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0eb9cccd-c6bd-4100-ba0f-ab18038d029d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:26.517388 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0eb9cccd-c6bd-4100-ba0f-ab18038d029d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:26.519055 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0eb9cccd-c6bd-4100-ba0f-ab18038d029d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:26.527253 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0eb9cccd-c6bd-4100-ba0f-ab18038d029d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:26.692308 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=100 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:42:26.867076 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-c47aec90-c97b-4021-b6c8-7257f646ec0b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:26.867076 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-c47aec90-c97b-4021-b6c8-7257f646ec0b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:26.903767 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c47aec90-c97b-4021-b6c8-7257f646ec0b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:26.910701 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c47aec90-c97b-4021-b6c8-7257f646ec0b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:26.914456 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c47aec90-c97b-4021-b6c8-7257f646ec0b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:26.930213 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c47aec90-c97b-4021-b6c8-7257f646ec0b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:27.138591 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0eb9cccd-c6bd-4100-ba0f-ab18038d029d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:27.151200 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0eb9cccd-c6bd-4100-ba0f-ab18038d029d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:27.153404 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0eb9cccd-c6bd-4100-ba0f-ab18038d029d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:27.156448 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-0eb9cccd-c6bd-4100-ba0f-ab18038d029d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1748 microversion: 2.20 time: 0.664503 Jul 12 17:42:27.159967 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 197/413] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:26 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1748 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:42:27.326999 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-c47aec90-c97b-4021-b6c8-7257f646ec0b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:27.343161 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-c47aec90-c97b-4021-b6c8-7257f646ec0b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1267 microversion: 2.1 time: 0.495167 Jul 12 17:42:27.354470 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 217/414] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:26 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1267 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:27.410845 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-4ae11d63-2e23-4790-b347-784898686363 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:27.411620 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-4ae11d63-2e23-4790-b347-784898686363 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:27.424702 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4ae11d63-2e23-4790-b347-784898686363 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:27.425187 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4ae11d63-2e23-4790-b347-784898686363 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:27.426216 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4ae11d63-2e23-4790-b347-784898686363 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:27.431344 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4ae11d63-2e23-4790-b347-784898686363 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:27.679151 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-4ae11d63-2e23-4790-b347-784898686363 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:27.744389 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-4ae11d63-2e23-4790-b347-784898686363 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1218 microversion: 2.1 time: 0.337722 Jul 12 17:42:27.747304 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 198/415] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:27 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1218 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:28.187064 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-95f9ccd1-2ad7-4570-9e0d-291d5e040348 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:28.191053 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-95f9ccd1-2ad7-4570-9e0d-291d5e040348 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:28.203059 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-95f9ccd1-2ad7-4570-9e0d-291d5e040348 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:28.205052 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-95f9ccd1-2ad7-4570-9e0d-291d5e040348 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:28.207528 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-95f9ccd1-2ad7-4570-9e0d-291d5e040348 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:28.207992 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-95f9ccd1-2ad7-4570-9e0d-291d5e040348 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:28.371522 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-2c6b4f08-034f-4472-b38d-e4e6a7bac89b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:28.372185 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-2c6b4f08-034f-4472-b38d-e4e6a7bac89b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:28.396363 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2c6b4f08-034f-4472-b38d-e4e6a7bac89b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:28.396363 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2c6b4f08-034f-4472-b38d-e4e6a7bac89b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:28.400856 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2c6b4f08-034f-4472-b38d-e4e6a7bac89b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:28.409543 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2c6b4f08-034f-4472-b38d-e4e6a7bac89b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:28.442150 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-95f9ccd1-2ad7-4570-9e0d-291d5e040348 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:28.460049 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-95f9ccd1-2ad7-4570-9e0d-291d5e040348 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:28.461853 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-95f9ccd1-2ad7-4570-9e0d-291d5e040348 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:28.463835 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-95f9ccd1-2ad7-4570-9e0d-291d5e040348 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1748 microversion: 2.20 time: 0.285213 Jul 12 17:42:28.465314 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 218/416] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:28 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1748 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:42:28.757814 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-2c6b4f08-034f-4472-b38d-e4e6a7bac89b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:28.768106 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-2c6b4f08-034f-4472-b38d-e4e6a7bac89b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1267 microversion: 2.1 time: 0.400745 Jul 12 17:42:28.773093 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 199/417] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:28 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1267 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:42:28.773351 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-5fd064b2-d13f-4eb6-a945-58d978ac7ef8 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:28.773814 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-5fd064b2-d13f-4eb6-a945-58d978ac7ef8 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:28.785343 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5fd064b2-d13f-4eb6-a945-58d978ac7ef8 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:28.787288 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5fd064b2-d13f-4eb6-a945-58d978ac7ef8 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:28.788459 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5fd064b2-d13f-4eb6-a945-58d978ac7ef8 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:28.788886 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5fd064b2-d13f-4eb6-a945-58d978ac7ef8 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:28.901817 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-5fd064b2-d13f-4eb6-a945-58d978ac7ef8 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:28.915415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-5fd064b2-d13f-4eb6-a945-58d978ac7ef8 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1266 microversion: 2.1 time: 0.146197 Jul 12 17:42:28.916227 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 219/418] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:28 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:29.507411 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-d26e76f0-186b-43b4-8d9f-4c3fb08a4791 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:29.508986 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-d26e76f0-186b-43b4-8d9f-4c3fb08a4791 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:29.516049 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d26e76f0-186b-43b4-8d9f-4c3fb08a4791 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:29.517117 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d26e76f0-186b-43b4-8d9f-4c3fb08a4791 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:29.518146 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d26e76f0-186b-43b4-8d9f-4c3fb08a4791 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:29.518801 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d26e76f0-186b-43b4-8d9f-4c3fb08a4791 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:29.747022 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-d26e76f0-186b-43b4-8d9f-4c3fb08a4791 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:29.761016 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-d26e76f0-186b-43b4-8d9f-4c3fb08a4791 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:29.762715 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-d26e76f0-186b-43b4-8d9f-4c3fb08a4791 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:29.772957 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-d26e76f0-186b-43b4-8d9f-4c3fb08a4791 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1748 microversion: 2.20 time: 0.271606 Jul 12 17:42:29.774402 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 200/419] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:29 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1748 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:42:29.800933 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-14abc2ca-d9ca-4b14-9a66-75257e7a799b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:29.810467 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-14abc2ca-d9ca-4b14-9a66-75257e7a799b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:29.819416 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-14abc2ca-d9ca-4b14-9a66-75257e7a799b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:29.820589 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-14abc2ca-d9ca-4b14-9a66-75257e7a799b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:29.821846 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-14abc2ca-d9ca-4b14-9a66-75257e7a799b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:29.822902 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-14abc2ca-d9ca-4b14-9a66-75257e7a799b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:29.943409 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-9bb1db62-a3c8-4e6d-9e14-88887c9ebc34 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:29.964561 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-9bb1db62-a3c8-4e6d-9e14-88887c9ebc34 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:29.979040 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9bb1db62-a3c8-4e6d-9e14-88887c9ebc34 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:29.979966 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9bb1db62-a3c8-4e6d-9e14-88887c9ebc34 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:29.981315 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9bb1db62-a3c8-4e6d-9e14-88887c9ebc34 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:29.982133 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9bb1db62-a3c8-4e6d-9e14-88887c9ebc34 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:30.191372 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-9bb1db62-a3c8-4e6d-9e14-88887c9ebc34 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:30.202307 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-9bb1db62-a3c8-4e6d-9e14-88887c9ebc34 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1266 microversion: 2.1 time: 0.268589 Jul 12 17:42:30.210049 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 201/420] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:29 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1266 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:30.277920 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-14abc2ca-d9ca-4b14-9a66-75257e7a799b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:30.291002 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-14abc2ca-d9ca-4b14-9a66-75257e7a799b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1267 microversion: 2.1 time: 0.495217 Jul 12 17:42:30.291969 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 220/421] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:29 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1267 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:42:30.806523 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-d745b627-bc56-46f9-81a4-9b185448cae8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:30.807367 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-d745b627-bc56-46f9-81a4-9b185448cae8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:30.814886 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d745b627-bc56-46f9-81a4-9b185448cae8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:30.815460 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d745b627-bc56-46f9-81a4-9b185448cae8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:30.816414 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d745b627-bc56-46f9-81a4-9b185448cae8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:30.816943 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d745b627-bc56-46f9-81a4-9b185448cae8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:31.017328 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-d745b627-bc56-46f9-81a4-9b185448cae8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:31.028304 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-d745b627-bc56-46f9-81a4-9b185448cae8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:31.029872 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-d745b627-bc56-46f9-81a4-9b185448cae8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:31.031161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-d745b627-bc56-46f9-81a4-9b185448cae8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1748 microversion: 2.20 time: 0.229357 Jul 12 17:42:31.032184 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 202/422] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:30 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1748 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:42:31.224115 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-06cdbf07-e7d3-40ab-ad40-f1574d0469d3 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:31.225337 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-06cdbf07-e7d3-40ab-ad40-f1574d0469d3 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:31.238565 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-06cdbf07-e7d3-40ab-ad40-f1574d0469d3 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:31.238565 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-06cdbf07-e7d3-40ab-ad40-f1574d0469d3 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:31.238565 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-06cdbf07-e7d3-40ab-ad40-f1574d0469d3 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:31.238565 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-06cdbf07-e7d3-40ab-ad40-f1574d0469d3 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:31.315912 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-06cdbf07-e7d3-40ab-ad40-f1574d0469d3 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:31.324988 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-ab77270e-b1ba-4ab8-86f5-edafefc06ef2 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:31.326329 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-ab77270e-b1ba-4ab8-86f5-edafefc06ef2 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:31.327477 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-06cdbf07-e7d3-40ab-ad40-f1574d0469d3 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1266 microversion: 2.1 time: 0.108049 Jul 12 17:42:31.328598 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 221/423] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:31 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:31.336539 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ab77270e-b1ba-4ab8-86f5-edafefc06ef2 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:31.337098 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ab77270e-b1ba-4ab8-86f5-edafefc06ef2 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:31.339202 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ab77270e-b1ba-4ab8-86f5-edafefc06ef2 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:31.339653 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ab77270e-b1ba-4ab8-86f5-edafefc06ef2 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:31.594932 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ab77270e-b1ba-4ab8-86f5-edafefc06ef2 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:31.610897 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-ab77270e-b1ba-4ab8-86f5-edafefc06ef2 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1267 microversion: 2.1 time: 0.289577 Jul 12 17:42:31.612172 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 203/424] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:31 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1267 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:42:32.064375 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a7f325bb-c70b-4d69-8879-e3cbe1b4058e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:32.066162 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-a7f325bb-c70b-4d69-8879-e3cbe1b4058e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:32.088262 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a7f325bb-c70b-4d69-8879-e3cbe1b4058e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:32.090343 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a7f325bb-c70b-4d69-8879-e3cbe1b4058e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:32.092551 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a7f325bb-c70b-4d69-8879-e3cbe1b4058e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:32.093707 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a7f325bb-c70b-4d69-8879-e3cbe1b4058e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:32.383214 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-70aedf72-860b-446d-b71c-34b9eb4d25ac tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:32.385224 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-70aedf72-860b-446d-b71c-34b9eb4d25ac tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:32.395042 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a7f325bb-c70b-4d69-8879-e3cbe1b4058e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:32.416194 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a7f325bb-c70b-4d69-8879-e3cbe1b4058e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:32.416414 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-70aedf72-860b-446d-b71c-34b9eb4d25ac tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:32.417552 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-70aedf72-860b-446d-b71c-34b9eb4d25ac tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:32.418029 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a7f325bb-c70b-4d69-8879-e3cbe1b4058e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:32.419083 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-70aedf72-860b-446d-b71c-34b9eb4d25ac tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:32.419588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-a7f325bb-c70b-4d69-8879-e3cbe1b4058e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1748 microversion: 2.20 time: 0.364332 Jul 12 17:42:32.420016 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-70aedf72-860b-446d-b71c-34b9eb4d25ac tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:32.433119 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 222/425] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:32 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1748 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:42:32.521076 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-70aedf72-860b-446d-b71c-34b9eb4d25ac tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:32.530048 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-70aedf72-860b-446d-b71c-34b9eb4d25ac tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1266 microversion: 2.1 time: 0.179571 Jul 12 17:42:32.531100 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 204/426] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:32 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:42:32.632381 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-82779e23-a787-4b5a-bddf-8ca43ed93606 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:32.633183 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-82779e23-a787-4b5a-bddf-8ca43ed93606 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:32.640307 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-82779e23-a787-4b5a-bddf-8ca43ed93606 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:32.640625 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-82779e23-a787-4b5a-bddf-8ca43ed93606 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:32.642116 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-82779e23-a787-4b5a-bddf-8ca43ed93606 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:32.642602 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-82779e23-a787-4b5a-bddf-8ca43ed93606 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:32.836704 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-82779e23-a787-4b5a-bddf-8ca43ed93606 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:32.845049 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-82779e23-a787-4b5a-bddf-8ca43ed93606 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1267 microversion: 2.1 time: 0.218057 Jul 12 17:42:32.845625 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 223/427] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:32 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1267 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:33.442794 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-a98de523-49aa-4097-b184-7e0d7bed2a70 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:33.444077 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-a98de523-49aa-4097-b184-7e0d7bed2a70 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:33.452660 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a98de523-49aa-4097-b184-7e0d7bed2a70 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:33.453607 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a98de523-49aa-4097-b184-7e0d7bed2a70 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:33.455484 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a98de523-49aa-4097-b184-7e0d7bed2a70 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:33.456405 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a98de523-49aa-4097-b184-7e0d7bed2a70 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:33.553691 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-d14999e3-82cb-4767-808f-89988bee312a tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:33.555435 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-d14999e3-82cb-4767-808f-89988bee312a tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:33.570982 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d14999e3-82cb-4767-808f-89988bee312a tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:33.573061 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d14999e3-82cb-4767-808f-89988bee312a tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:33.574187 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d14999e3-82cb-4767-808f-89988bee312a tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:33.574881 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d14999e3-82cb-4767-808f-89988bee312a tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:33.655848 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-d14999e3-82cb-4767-808f-89988bee312a tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:33.666391 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-d14999e3-82cb-4767-808f-89988bee312a tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1266 microversion: 2.1 time: 0.121116 Jul 12 17:42:33.667063 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 224/428] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:33 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1266 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:42:33.693988 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-a98de523-49aa-4097-b184-7e0d7bed2a70 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:33.715944 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-a98de523-49aa-4097-b184-7e0d7bed2a70 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:33.719146 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-a98de523-49aa-4097-b184-7e0d7bed2a70 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:33.729032 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-a98de523-49aa-4097-b184-7e0d7bed2a70 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1748 microversion: 2.20 time: 0.292102 Jul 12 17:42:33.730033 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 205/429] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:33 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1748 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:42:33.870662 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a43967f7-089e-4366-ba2b-71bd0508cc65 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:33.870662 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-a43967f7-089e-4366-ba2b-71bd0508cc65 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:33.878241 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a43967f7-089e-4366-ba2b-71bd0508cc65 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:33.878241 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a43967f7-089e-4366-ba2b-71bd0508cc65 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:33.878241 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a43967f7-089e-4366-ba2b-71bd0508cc65 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:33.878241 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a43967f7-089e-4366-ba2b-71bd0508cc65 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:34.058376 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a43967f7-089e-4366-ba2b-71bd0508cc65 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:34.067913 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-a43967f7-089e-4366-ba2b-71bd0508cc65 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1267 microversion: 2.1 time: 0.210510 Jul 12 17:42:34.068503 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 225/430] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:33 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1267 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:34.714037 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-906983d4-1b9a-4c41-b4b3-50a618ce6634 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:34.714037 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-906983d4-1b9a-4c41-b4b3-50a618ce6634 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:34.714037 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell0:SELECT=2 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:42:34.714037 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-906983d4-1b9a-4c41-b4b3-50a618ce6634 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:34.714037 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-906983d4-1b9a-4c41-b4b3-50a618ce6634 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:34.715181 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-906983d4-1b9a-4c41-b4b3-50a618ce6634 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:34.715181 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-906983d4-1b9a-4c41-b4b3-50a618ce6634 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:34.760743 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-57b0a496-9464-43a7-999c-8fc78838c3b9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:34.761326 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-57b0a496-9464-43a7-999c-8fc78838c3b9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:34.766001 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-906983d4-1b9a-4c41-b4b3-50a618ce6634 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:34.769078 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-57b0a496-9464-43a7-999c-8fc78838c3b9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:34.769572 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-57b0a496-9464-43a7-999c-8fc78838c3b9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:34.770352 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-57b0a496-9464-43a7-999c-8fc78838c3b9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:34.770826 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-57b0a496-9464-43a7-999c-8fc78838c3b9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:34.774946 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-906983d4-1b9a-4c41-b4b3-50a618ce6634 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1274 microversion: 2.1 time: 0.090523 Jul 12 17:42:34.775428 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 206/431] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:34 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1274 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:34.925349 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-57b0a496-9464-43a7-999c-8fc78838c3b9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:34.933930 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-57b0a496-9464-43a7-999c-8fc78838c3b9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:34.940246 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-57b0a496-9464-43a7-999c-8fc78838c3b9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:34.941494 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-57b0a496-9464-43a7-999c-8fc78838c3b9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1750 microversion: 2.20 time: 0.184772 Jul 12 17:42:34.942309 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 226/432] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:34 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1750 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:42:35.086487 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-4dfc5bcd-ea80-48e3-83c2-6e439238aae3 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:35.087009 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-4dfc5bcd-ea80-48e3-83c2-6e439238aae3 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:35.093085 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4dfc5bcd-ea80-48e3-83c2-6e439238aae3 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:35.093527 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4dfc5bcd-ea80-48e3-83c2-6e439238aae3 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:35.094288 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4dfc5bcd-ea80-48e3-83c2-6e439238aae3 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:35.094869 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4dfc5bcd-ea80-48e3-83c2-6e439238aae3 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:35.209407 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell0:SELECT=8 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:42:35.252554 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-4dfc5bcd-ea80-48e3-83c2-6e439238aae3 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:35.262931 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-4dfc5bcd-ea80-48e3-83c2-6e439238aae3 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1267 microversion: 2.1 time: 0.180865 Jul 12 17:42:35.263880 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 207/433] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:35 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:35.793821 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-3d60a5fd-b8ec-44be-9ecb-baadb8c8704c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:35.794475 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-3d60a5fd-b8ec-44be-9ecb-baadb8c8704c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:35.803094 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3d60a5fd-b8ec-44be-9ecb-baadb8c8704c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:35.803905 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3d60a5fd-b8ec-44be-9ecb-baadb8c8704c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:35.804771 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3d60a5fd-b8ec-44be-9ecb-baadb8c8704c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:35.805216 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3d60a5fd-b8ec-44be-9ecb-baadb8c8704c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:35.830220 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:42:35.897589 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-3d60a5fd-b8ec-44be-9ecb-baadb8c8704c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:35.905537 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-3d60a5fd-b8ec-44be-9ecb-baadb8c8704c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1274 microversion: 2.1 time: 0.116124 Jul 12 17:42:35.906131 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 227/434] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:35 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1274 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:35.960570 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-57a48739-baa1-47bd-b4ce-171e838c9a16 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:35.961878 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-57a48739-baa1-47bd-b4ce-171e838c9a16 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:35.969913 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-57a48739-baa1-47bd-b4ce-171e838c9a16 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:35.970367 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-57a48739-baa1-47bd-b4ce-171e838c9a16 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:35.971173 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-57a48739-baa1-47bd-b4ce-171e838c9a16 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:35.971777 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-57a48739-baa1-47bd-b4ce-171e838c9a16 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:36.131138 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-57a48739-baa1-47bd-b4ce-171e838c9a16 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:36.143624 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-57a48739-baa1-47bd-b4ce-171e838c9a16 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:36.145157 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-57a48739-baa1-47bd-b4ce-171e838c9a16 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:36.146364 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-57a48739-baa1-47bd-b4ce-171e838c9a16 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1750 microversion: 2.20 time: 0.189843 Jul 12 17:42:36.147145 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 208/435] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:35 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1750 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:42:36.282312 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-c9114393-79c1-4ca2-a71b-ce73a68f3be4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:36.283248 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-c9114393-79c1-4ca2-a71b-ce73a68f3be4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:36.292030 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c9114393-79c1-4ca2-a71b-ce73a68f3be4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:36.292613 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c9114393-79c1-4ca2-a71b-ce73a68f3be4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:36.293759 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c9114393-79c1-4ca2-a71b-ce73a68f3be4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:36.294334 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c9114393-79c1-4ca2-a71b-ce73a68f3be4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:36.376829 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell0:SELECT=2 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:42:36.452907 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-c9114393-79c1-4ca2-a71b-ce73a68f3be4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:36.464054 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-c9114393-79c1-4ca2-a71b-ce73a68f3be4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1267 microversion: 2.1 time: 0.185826 Jul 12 17:42:36.464709 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 228/436] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:36 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:42:36.923227 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-3cbc3b62-51ea-4158-97cd-2bb21c0df50c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:36.923865 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-3cbc3b62-51ea-4158-97cd-2bb21c0df50c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:36.930859 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3cbc3b62-51ea-4158-97cd-2bb21c0df50c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:36.931318 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3cbc3b62-51ea-4158-97cd-2bb21c0df50c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:36.932108 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3cbc3b62-51ea-4158-97cd-2bb21c0df50c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:36.932553 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3cbc3b62-51ea-4158-97cd-2bb21c0df50c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:37.013802 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-3cbc3b62-51ea-4158-97cd-2bb21c0df50c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:37.023702 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-3cbc3b62-51ea-4158-97cd-2bb21c0df50c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1274 microversion: 2.1 time: 0.104772 Jul 12 17:42:37.033658 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 209/437] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:36 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1274 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:37.171401 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-9771db45-9ed9-442d-900f-3397d1147879 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:37.172028 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-9771db45-9ed9-442d-900f-3397d1147879 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:37.183943 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9771db45-9ed9-442d-900f-3397d1147879 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:37.184591 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9771db45-9ed9-442d-900f-3397d1147879 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:37.185550 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9771db45-9ed9-442d-900f-3397d1147879 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:37.186146 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9771db45-9ed9-442d-900f-3397d1147879 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:37.213953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-c1bd8484-af97-4ea6-bb24-8c591dfeb736 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:37.214600 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-c1bd8484-af97-4ea6-bb24-8c591dfeb736 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:37.222107 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c1bd8484-af97-4ea6-bb24-8c591dfeb736 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:37.222699 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c1bd8484-af97-4ea6-bb24-8c591dfeb736 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:37.223782 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c1bd8484-af97-4ea6-bb24-8c591dfeb736 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:37.224288 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c1bd8484-af97-4ea6-bb24-8c591dfeb736 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:37.251883 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-c1bd8484-af97-4ea6-bb24-8c591dfeb736 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd/ips" status: 200 len: 148 microversion: 2.1 time: 0.043498 Jul 12 17:42:37.252576 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 210/438] 10.222.0.16 () {58 vars in 1247 bytes} [Tue Jul 12 17:42:37 2022] GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd/ips => generated 148 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:42:37.263687 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-7d8c6cd9-1154-471a-8742-c174c8c09e72 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a75ab260-fa20-4bc4-ba8b-e43b3b07b894"}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:42:37.265394 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-7d8c6cd9-1154-471a-8742-c174c8c09e72 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:37.272047 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7d8c6cd9-1154-471a-8742-c174c8c09e72 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:37.272600 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7d8c6cd9-1154-471a-8742-c174c8c09e72 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:37.273470 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7d8c6cd9-1154-471a-8742-c174c8c09e72 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:37.273984 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7d8c6cd9-1154-471a-8742-c174c8c09e72 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:37.369264 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-9771db45-9ed9-442d-900f-3397d1147879 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:37.394534 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.wsgi [None req-7d8c6cd9-1154-471a-8742-c174c8c09e72 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] HTTP exception thrown: Invalid volume: volume a75ab260-fa20-4bc4-ba8b-e43b3b07b894 is already attached to instances: edf55e8a-cbc1-45b6-a138-21d5a07301d9 Jul 12 17:42:37.396715 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-9771db45-9ed9-442d-900f-3397d1147879 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:37.397342 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-7d8c6cd9-1154-471a-8742-c174c8c09e72 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Request method failure captured: Jul 12 17:42:37.397342 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: request: POST /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd/os-volume_attachments HTTP/1.1 Jul 12 17:42:37.397342 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept: application/json Jul 12 17:42:37.397342 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept-Encoding: identity Jul 12 17:42:37.397342 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Connection: close Jul 12 17:42:37.397342 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Length: 74 Jul 12 17:42:37.397342 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Type: application/json Jul 12 17:42:37.397342 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Host: 10.222.0.16 Jul 12 17:42:37.397342 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Openstack-System-Scope: None Jul 12 17:42:37.397342 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: User-Agent: python-urllib3/1.26.9 Jul 12 17:42:37.397342 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Auth-Token: gAAAAABizbHIKPX81cOSzuTp0O3vMBUQ_2pscgJx1VEp1s8R65yvOz2oUKOjUaqFlJmNQdapSExRqaTx7so1aRxIG_vuYNvJ_o-Kb6m698uGIk6QmB9ep_Ed50ORq5_o-D700OCaKd2Eu3BHwptAzFT8ZMufAhu8lzyW1do401lCvRn-uiuATyM Jul 12 17:42:37.397342 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Id: None Jul 12 17:42:37.397342 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Name: None Jul 12 17:42:37.397342 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Identity-Status: Confirmed Jul 12 17:42:37.397342 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Is-Admin-Project: True Jul 12 17:42:37.397342 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Id: default Jul 12 17:42:37.397342 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Name: Default Jul 12 17:42:37.397342 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Id: 84b840eaa59d4f73ac68926437f03d82 Jul 12 17:42:37.397342 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Name: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:42:37.397342 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Role: reader,member Jul 12 17:42:37.397342 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Roles: reader,member Jul 12 17:42:37.398837 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84b840eaa59d4f73ac68926437f03d82", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:42:37.398837 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:42:37.398837 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Id: 84b840eaa59d4f73ac68926437f03d82 Jul 12 17:42:37.398837 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:42:37.398837 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User: tempest-AttachVolumeNegativeTest-834922830-project Jul 12 17:42:37.398837 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Id: default Jul 12 17:42:37.398837 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Name: Default Jul 12 17:42:37.398837 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Id: c8441a4a72154ee3bbb95af66abf2ffd Jul 12 17:42:37.398837 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Name: tempest-AttachVolumeNegativeTest-834922830-project Jul 12 17:42:37.398837 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Jul 12 17:42:37.398837 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: {"volumeAttachment": {"volumeId": "a75ab260-fa20-4bc4-ba8b-e43b3b07b894"}} Jul 12 17:42:37.398837 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: method: > Jul 12 17:42:37.399602 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: exception: Invalid volume: volume a75ab260-fa20-4bc4-ba8b-e43b3b07b894 is already attached to instances: edf55e8a-cbc1-45b6-a138-21d5a07301d9 Jul 12 17:42:37.399602 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: action_args: {'server_id': 'dfbdba37-86d8-477a-95a8-9bef8b6df8dd', 'body': {'volumeAttachment': {'volumeId': 'a75ab260-fa20-4bc4-ba8b-e43b3b07b894'}}} Jul 12 17:42:37.399602 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:42:37.399602 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:42:37.399602 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 17:42:37.399602 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 17:42:37.399602 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 17:42:37.399602 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 17:42:37.399602 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 12 17:42:37.399602 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 12 17:42:37.399602 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 12 17:42:37.399602 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 12 17:42:37.399602 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 12 17:42:37.399602 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 12 17:42:37.399602 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a75ab260-fa20-4bc4-ba8b-e43b3b07b894 is already attached to instances: edf55e8a-cbc1-45b6-a138-21d5a07301d9 Jul 12 17:42:37.399602 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:42:37.399602 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:42:37.399602 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:42:37.399602 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:42:37.400770 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:42:37.400770 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:42:37.400770 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:42:37.400770 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:42:37.400770 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:42:37.400770 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:42:37.400770 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 17:42:37.400770 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 17:42:37.400770 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 17:42:37.400770 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 17:42:37.400770 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 17:42:37.400770 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 17:42:37.400770 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 12 17:42:37.400770 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 12 17:42:37.400770 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a75ab260-fa20-4bc4-ba8b-e43b3b07b894 is already attached to instances: edf55e8a-cbc1-45b6-a138-21d5a07301d9 Jul 12 17:42:37.400770 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:42:37.400770 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:42:37.400770 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:42:37.400770 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:42:37.400770 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:42:37.402644 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:42:37.402644 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:42:37.402644 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:42:37.402644 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a75ab260-fa20-4bc4-ba8b-e43b3b07b894 is already attached to instances: edf55e8a-cbc1-45b6-a138-21d5a07301d9 Jul 12 17:42:37.402644 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:42:37.402969 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-9771db45-9ed9-442d-900f-3397d1147879 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:37.402969 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-9771db45-9ed9-442d-900f-3397d1147879 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1750 microversion: 2.20 time: 0.235184 Jul 12 17:42:37.402969 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 229/439] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:37 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1750 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:42:37.404310 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-7d8c6cd9-1154-471a-8742-c174c8c09e72 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Returning 400 to user: Invalid volume: volume a75ab260-fa20-4bc4-ba8b-e43b3b07b894 is already attached to instances: edf55e8a-cbc1-45b6-a138-21d5a07301d9 {{(pid=130058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:42:37.405416 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-7d8c6cd9-1154-471a-8742-c174c8c09e72 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "POST /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.146115 Jul 12 17:42:37.410621 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 211/440] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jul 12 17:42:37 2022] POST /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd/os-volume_attachments => generated 174 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 17:42:37.416348 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-5d82c618-c8d3-40b3-8183-dedfc474fb1c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:37.416840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-5d82c618-c8d3-40b3-8183-dedfc474fb1c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:37.423324 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5d82c618-c8d3-40b3-8183-dedfc474fb1c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:37.423857 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5d82c618-c8d3-40b3-8183-dedfc474fb1c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:37.424646 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5d82c618-c8d3-40b3-8183-dedfc474fb1c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:37.425084 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5d82c618-c8d3-40b3-8183-dedfc474fb1c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:37.456852 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-5d82c618-c8d3-40b3-8183-dedfc474fb1c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Going to try to terminate instance {{(pid=130059) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:42:37.481369 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-ed9bf5ca-92e8-460b-ad60-60018df007df tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:37.482095 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-ed9bf5ca-92e8-460b-ad60-60018df007df tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:37.492482 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ed9bf5ca-92e8-460b-ad60-60018df007df tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:37.498507 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ed9bf5ca-92e8-460b-ad60-60018df007df tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:37.498507 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ed9bf5ca-92e8-460b-ad60-60018df007df tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:37.498507 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ed9bf5ca-92e8-460b-ad60-60018df007df tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:37.832319 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ed9bf5ca-92e8-460b-ad60-60018df007df tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:37.832516 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-5d82c618-c8d3-40b3-8183-dedfc474fb1c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd" status: 204 len: 0 microversion: 2.1 time: 0.416608 Jul 12 17:42:37.832516 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 230/441] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 12 17:42:37 2022] DELETE /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:42:37.862064 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-71b78dae-e4c5-4088-940a-21afa85b7f0a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:37.867950 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-71b78dae-e4c5-4088-940a-21afa85b7f0a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:37.871229 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-ed9bf5ca-92e8-460b-ad60-60018df007df tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1267 microversion: 2.1 time: 0.393832 Jul 12 17:42:37.882390 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 212/442] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:37 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1267 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:37.890737 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-71b78dae-e4c5-4088-940a-21afa85b7f0a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:37.891189 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-71b78dae-e4c5-4088-940a-21afa85b7f0a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:37.892052 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-71b78dae-e4c5-4088-940a-21afa85b7f0a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:37.893482 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-71b78dae-e4c5-4088-940a-21afa85b7f0a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:38.044810 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-02d3234c-7677-4ae6-8bdc-f7a82dba7b92 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:38.045718 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-02d3234c-7677-4ae6-8bdc-f7a82dba7b92 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:38.068584 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-02d3234c-7677-4ae6-8bdc-f7a82dba7b92 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:38.069324 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-02d3234c-7677-4ae6-8bdc-f7a82dba7b92 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:38.070811 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-02d3234c-7677-4ae6-8bdc-f7a82dba7b92 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:38.071543 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-02d3234c-7677-4ae6-8bdc-f7a82dba7b92 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:38.112991 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-71b78dae-e4c5-4088-940a-21afa85b7f0a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:38.121196 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-71b78dae-e4c5-4088-940a-21afa85b7f0a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd" status: 200 len: 1679 microversion: 2.1 time: 0.269742 Jul 12 17:42:38.122230 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 231/443] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:37 2022] GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd => generated 1679 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:38.158079 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-02d3234c-7677-4ae6-8bdc-f7a82dba7b92 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:38.175767 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-02d3234c-7677-4ae6-8bdc-f7a82dba7b92 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1274 microversion: 2.1 time: 0.136381 Jul 12 17:42:38.175767 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 213/444] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:38 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1274 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:42:38.419147 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a7b4bed9-d4a9-43da-9ffd-d8ac5cd3511a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:38.420186 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-a7b4bed9-d4a9-43da-9ffd-d8ac5cd3511a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:38.427360 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a7b4bed9-d4a9-43da-9ffd-d8ac5cd3511a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:38.427815 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a7b4bed9-d4a9-43da-9ffd-d8ac5cd3511a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:38.428600 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a7b4bed9-d4a9-43da-9ffd-d8ac5cd3511a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:38.429038 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a7b4bed9-d4a9-43da-9ffd-d8ac5cd3511a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:38.598221 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a7b4bed9-d4a9-43da-9ffd-d8ac5cd3511a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:38.607313 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a7b4bed9-d4a9-43da-9ffd-d8ac5cd3511a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:38.608848 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a7b4bed9-d4a9-43da-9ffd-d8ac5cd3511a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:38.610233 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-a7b4bed9-d4a9-43da-9ffd-d8ac5cd3511a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1750 microversion: 2.20 time: 0.194974 Jul 12 17:42:38.611142 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 232/445] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:38 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1750 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:42:38.892914 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-41e1aee7-7a80-46f8-a574-3d4467a832b4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:38.907024 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-41e1aee7-7a80-46f8-a574-3d4467a832b4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:38.907024 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-41e1aee7-7a80-46f8-a574-3d4467a832b4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:38.907024 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-41e1aee7-7a80-46f8-a574-3d4467a832b4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:38.907024 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-41e1aee7-7a80-46f8-a574-3d4467a832b4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:38.908134 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-41e1aee7-7a80-46f8-a574-3d4467a832b4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:38.928117 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=100 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:42:39.140848 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-c8d1dd66-2342-4e4d-b127-838bce8ced75 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:39.141418 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-c8d1dd66-2342-4e4d-b127-838bce8ced75 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:39.157396 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c8d1dd66-2342-4e4d-b127-838bce8ced75 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:39.157856 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c8d1dd66-2342-4e4d-b127-838bce8ced75 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:39.158980 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c8d1dd66-2342-4e4d-b127-838bce8ced75 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:39.159484 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c8d1dd66-2342-4e4d-b127-838bce8ced75 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:39.167681 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-41e1aee7-7a80-46f8-a574-3d4467a832b4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:39.190124 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-41e1aee7-7a80-46f8-a574-3d4467a832b4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1267 microversion: 2.1 time: 0.301418 Jul 12 17:42:39.203552 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 214/446] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:38 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1267 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:39.217246 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-63ec1a2e-70e6-4632-bc95-637b46eee411 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:39.218240 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-63ec1a2e-70e6-4632-bc95-637b46eee411 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:39.229956 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-63ec1a2e-70e6-4632-bc95-637b46eee411 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:39.231086 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-63ec1a2e-70e6-4632-bc95-637b46eee411 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:39.232941 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-63ec1a2e-70e6-4632-bc95-637b46eee411 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:39.233845 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-63ec1a2e-70e6-4632-bc95-637b46eee411 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:39.380697 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-63ec1a2e-70e6-4632-bc95-637b46eee411 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:39.396350 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-63ec1a2e-70e6-4632-bc95-637b46eee411 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1284 microversion: 2.1 time: 0.190036 Jul 12 17:42:39.396831 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 215/447] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:39 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1284 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:39.436280 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-c8d1dd66-2342-4e4d-b127-838bce8ced75 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:39.463677 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-c8d1dd66-2342-4e4d-b127-838bce8ced75 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd" status: 200 len: 1679 microversion: 2.1 time: 0.326428 Jul 12 17:42:39.464630 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 233/448] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:39 2022] GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd => generated 1679 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:42:39.635659 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-e8039fc7-2b4c-4c4d-b56b-aa03a795a1c9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:39.641448 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-e8039fc7-2b4c-4c4d-b56b-aa03a795a1c9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:39.650279 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e8039fc7-2b4c-4c4d-b56b-aa03a795a1c9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:39.651129 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e8039fc7-2b4c-4c4d-b56b-aa03a795a1c9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:39.652257 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e8039fc7-2b4c-4c4d-b56b-aa03a795a1c9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:39.652977 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e8039fc7-2b4c-4c4d-b56b-aa03a795a1c9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:39.980090 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-e8039fc7-2b4c-4c4d-b56b-aa03a795a1c9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:39.996272 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-e8039fc7-2b4c-4c4d-b56b-aa03a795a1c9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:39.998074 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-e8039fc7-2b4c-4c4d-b56b-aa03a795a1c9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:39.999345 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-e8039fc7-2b4c-4c4d-b56b-aa03a795a1c9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1750 microversion: 2.20 time: 0.371595 Jul 12 17:42:40.002922 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 216/449] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:39 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1750 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:42:40.192761 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-02bae667-c00f-42d3-abdd-74e47fc1b8d0 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Action: 'create', calling method: .version_select at 0x7f479fdde790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-401296661", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNESrTWsRXyiZptbIP6eS/LaNQXyX/Ik7Y4vCEaUeCiGVlYt/JqLTKXp7Ng7QLVc37u1sAxQd7WRuNfAiRe9uKbusB0tylbZj/lN+qTr+3UBJ5aMNtg+KhS8vMgSp8lYPw=="}} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:42:40.209761 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.quota [None req-02bae667-c00f-42d3-abdd-74e47fc1b8d0 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Getting quotas for project 80285308991b47308701fd3363bec122. Resources: {'key_pairs'} {{(pid=130059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:42:40.214271 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.quota [None req-02bae667-c00f-42d3-abdd-74e47fc1b8d0 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Getting quotas for user ed4726967dd844b692fa7badd510267a and project 80285308991b47308701fd3363bec122. Resources: {'key_pairs'} {{(pid=130059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:42:40.217742 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-a9df363a-e27a-4fb0-890f-473fd3fb95d7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:40.218402 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-a9df363a-e27a-4fb0-890f-473fd3fb95d7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:40.226266 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a9df363a-e27a-4fb0-890f-473fd3fb95d7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:40.229738 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a9df363a-e27a-4fb0-890f-473fd3fb95d7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:40.231141 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a9df363a-e27a-4fb0-890f-473fd3fb95d7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:40.231971 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a9df363a-e27a-4fb0-890f-473fd3fb95d7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:40.237486 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:42:40.318061 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-02bae667-c00f-42d3-abdd-74e47fc1b8d0 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.129551 Jul 12 17:42:40.318723 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 234/450] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Jul 12 17:42:40 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:42:40.415468 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-05b4d8c8-dbad-43f4-9911-10d14da6476e tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:40.416293 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-05b4d8c8-dbad-43f4-9911-10d14da6476e tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:40.428096 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-05b4d8c8-dbad-43f4-9911-10d14da6476e tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:40.428648 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-05b4d8c8-dbad-43f4-9911-10d14da6476e tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:40.429506 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-05b4d8c8-dbad-43f4-9911-10d14da6476e tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:40.430025 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-05b4d8c8-dbad-43f4-9911-10d14da6476e tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:40.510910 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-05b4d8c8-dbad-43f4-9911-10d14da6476e tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:40.521702 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-05b4d8c8-dbad-43f4-9911-10d14da6476e tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1272 microversion: 2.1 time: 0.110087 Jul 12 17:42:40.531909 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 235/451] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:40 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1272 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:42:40.531909 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-85e178bc-c914-497b-b4a5-5cfbb2854649 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-126677754", "imageRef": "a899e9f1-4d94-4853-972d-5a8ee87d87e8", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-401296661", "networks": [{"uuid": "1b572705-7b66-4f76-8508-7edd20c0d361"}]}} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:42:40.607964 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.network.neutron [None req-85e178bc-c914-497b-b4a5-5cfbb2854649 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] validate_networks() for [('1b572705-7b66-4f76-8508-7edd20c0d361', None, None, None, None, None)] {{(pid=130059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:42:40.608108 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-a9df363a-e27a-4fb0-890f-473fd3fb95d7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:40.618732 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-a9df363a-e27a-4fb0-890f-473fd3fb95d7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1267 microversion: 2.1 time: 0.405109 Jul 12 17:42:40.619636 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 217/452] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:40 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1267 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:42:40.624933 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-6ecc3953-887c-4f6b-ac31-1b36cbb3d7be tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:40.626799 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-6ecc3953-887c-4f6b-ac31-1b36cbb3d7be tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:40.633814 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6ecc3953-887c-4f6b-ac31-1b36cbb3d7be tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:40.634758 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6ecc3953-887c-4f6b-ac31-1b36cbb3d7be tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:40.635854 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6ecc3953-887c-4f6b-ac31-1b36cbb3d7be tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:40.636773 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6ecc3953-887c-4f6b-ac31-1b36cbb3d7be tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:40.957726 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-6ecc3953-887c-4f6b-ac31-1b36cbb3d7be tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:40.977791 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-6ecc3953-887c-4f6b-ac31-1b36cbb3d7be tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd" status: 200 len: 1679 microversion: 2.1 time: 0.354529 Jul 12 17:42:40.977791 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 218/453] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:40 2022] GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd => generated 1679 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:41.019354 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-e00c362c-eaad-48b1-9edb-841f293c16ed tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:41.019971 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-e00c362c-eaad-48b1-9edb-841f293c16ed tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:41.026215 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e00c362c-eaad-48b1-9edb-841f293c16ed tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:41.026981 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e00c362c-eaad-48b1-9edb-841f293c16ed tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:41.027776 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e00c362c-eaad-48b1-9edb-841f293c16ed tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:41.028380 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e00c362c-eaad-48b1-9edb-841f293c16ed tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:41.097837 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-85e178bc-c914-497b-b4a5-5cfbb2854649 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Flavor limits 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:42:41.098260 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-85e178bc-c914-497b-b4a5-5cfbb2854649 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Image limits 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:42:41.098837 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-85e178bc-c914-497b-b4a5-5cfbb2854649 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Flavor pref 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:42:41.099247 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-85e178bc-c914-497b-b4a5-5cfbb2854649 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Image pref 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:42:41.099654 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-85e178bc-c914-497b-b4a5-5cfbb2854649 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:42:41.110478 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-85e178bc-c914-497b-b4a5-5cfbb2854649 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:41.115567 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-85e178bc-c914-497b-b4a5-5cfbb2854649 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:41.115567 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-85e178bc-c914-497b-b4a5-5cfbb2854649 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:41.115567 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-85e178bc-c914-497b-b4a5-5cfbb2854649 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:41.137553 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.quota [None req-85e178bc-c914-497b-b4a5-5cfbb2854649 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Getting quotas for project 80285308991b47308701fd3363bec122. Resources: {'cores', 'instances', 'ram'} {{(pid=130059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:42:41.143355 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.quota [None req-85e178bc-c914-497b-b4a5-5cfbb2854649 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Getting quotas for user ed4726967dd844b692fa7badd510267a and project 80285308991b47308701fd3363bec122. Resources: {'cores', 'instances', 'ram'} {{(pid=130059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:42:41.163232 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-85e178bc-c914-497b-b4a5-5cfbb2854649 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Going to run 1 instances... {{(pid=130059) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:42:41.165687 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-85e178bc-c914-497b-b4a5-5cfbb2854649 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a899e9f1-4d94-4853-972d-5a8ee87d87e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:42:41.326732 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-85e178bc-c914-497b-b4a5-5cfbb2854649 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.802879 Jul 12 17:42:41.327655 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 236/454] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 12 17:42:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:42:41.351193 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-1c392a15-57cf-40d0-b0aa-cf2c63552b4b tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:41.351962 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-1c392a15-57cf-40d0-b0aa-cf2c63552b4b tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:41.489786 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-e00c362c-eaad-48b1-9edb-841f293c16ed tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:41.505486 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-e00c362c-eaad-48b1-9edb-841f293c16ed tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:41.511129 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-e00c362c-eaad-48b1-9edb-841f293c16ed tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:41.515298 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-e00c362c-eaad-48b1-9edb-841f293c16ed tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1806 microversion: 2.20 time: 0.497895 Jul 12 17:42:41.518689 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 219/455] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:41 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1806 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:42:41.542274 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-cf9dcc6f-28e8-4a24-8ab0-0de6ebdf3342 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:41.543078 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-cf9dcc6f-28e8-4a24-8ab0-0de6ebdf3342 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:41.553939 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cf9dcc6f-28e8-4a24-8ab0-0de6ebdf3342 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:41.555042 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cf9dcc6f-28e8-4a24-8ab0-0de6ebdf3342 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:41.556085 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cf9dcc6f-28e8-4a24-8ab0-0de6ebdf3342 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:41.556853 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cf9dcc6f-28e8-4a24-8ab0-0de6ebdf3342 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:41.598874 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-1c392a15-57cf-40d0-b0aa-cf2c63552b4b tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:41.612499 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-1c392a15-57cf-40d0-b0aa-cf2c63552b4b tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1257 microversion: 2.1 time: 0.273154 Jul 12 17:42:41.613326 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 237/456] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:41 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1257 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:41.642454 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-1e20293b-507f-4850-b34d-4fcfa211233f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:41.643166 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-1e20293b-507f-4850-b34d-4fcfa211233f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:41.656725 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1e20293b-507f-4850-b34d-4fcfa211233f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:41.657170 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1e20293b-507f-4850-b34d-4fcfa211233f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:41.658382 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1e20293b-507f-4850-b34d-4fcfa211233f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:41.659371 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1e20293b-507f-4850-b34d-4fcfa211233f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:42.041498 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-1e20293b-507f-4850-b34d-4fcfa211233f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:42.056917 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-1e20293b-507f-4850-b34d-4fcfa211233f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1267 microversion: 2.1 time: 0.417550 Jul 12 17:42:42.058747 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 238/457] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:41 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1267 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:42:42.071625 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-8c54f669-7869-4ec2-9073-caf86f32968f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:42.072759 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-8c54f669-7869-4ec2-9073-caf86f32968f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:42.079778 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8c54f669-7869-4ec2-9073-caf86f32968f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:42.080709 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8c54f669-7869-4ec2-9073-caf86f32968f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:42.091348 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8c54f669-7869-4ec2-9073-caf86f32968f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:42.092374 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8c54f669-7869-4ec2-9073-caf86f32968f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:42.192772 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-8c54f669-7869-4ec2-9073-caf86f32968f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:42.200553 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-cf9dcc6f-28e8-4a24-8ab0-0de6ebdf3342 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:42.205174 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-8c54f669-7869-4ec2-9073-caf86f32968f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd" status: 200 len: 1612 microversion: 2.1 time: 0.145046 Jul 12 17:42:42.206499 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 239/458] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:42 2022] GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd => generated 1612 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:42.209680 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-cf9dcc6f-28e8-4a24-8ab0-0de6ebdf3342 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1314 microversion: 2.1 time: 0.672287 Jul 12 17:42:42.222602 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 220/459] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:41 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1314 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:42.254245 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-572a0bb6-a71d-4811-8b2e-4d3f5227b8b0 req-27065d14-5354-48f4-bace-7cbc4d67c94f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfbdba37-86d8-477a-95a8-9bef8b6df8dd", "name": "network-vif-deleted", "tag": "7b3f7474-31df-4980-b89d-6bb57a621f7b"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:42:42.286621 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-572a0bb6-a71d-4811-8b2e-4d3f5227b8b0 req-27065d14-5354-48f4-bace-7cbc4d67c94f service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:42.296122 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-572a0bb6-a71d-4811-8b2e-4d3f5227b8b0 req-27065d14-5354-48f4-bace-7cbc4d67c94f service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:42.311573 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-572a0bb6-a71d-4811-8b2e-4d3f5227b8b0 req-27065d14-5354-48f4-bace-7cbc4d67c94f service nova] Creating event network-vif-deleted:7b3f7474-31df-4980-b89d-6bb57a621f7b for instance dfbdba37-86d8-477a-95a8-9bef8b6df8dd on hv-cinder-84875 Jul 12 17:42:42.318265 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-572a0bb6-a71d-4811-8b2e-4d3f5227b8b0 req-27065d14-5354-48f4-bace-7cbc4d67c94f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071334 Jul 12 17:42:42.320420 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 240/460] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:42:42.542217 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-11f0b84b-0fca-4baf-a263-9f9f53404ba6 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:42.546207 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-11f0b84b-0fca-4baf-a263-9f9f53404ba6 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:42.559008 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-11f0b84b-0fca-4baf-a263-9f9f53404ba6 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:42.561604 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-11f0b84b-0fca-4baf-a263-9f9f53404ba6 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:42.564390 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-11f0b84b-0fca-4baf-a263-9f9f53404ba6 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:42.566773 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-11f0b84b-0fca-4baf-a263-9f9f53404ba6 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:42.632864 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-8fbd2987-1c41-4302-b15a-f6b630884d2c tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:42.633679 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-8fbd2987-1c41-4302-b15a-f6b630884d2c tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:42.778763 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-8fbd2987-1c41-4302-b15a-f6b630884d2c tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:42.794943 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-8fbd2987-1c41-4302-b15a-f6b630884d2c tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1257 microversion: 2.1 time: 0.169029 Jul 12 17:42:42.799031 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 241/461] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:42 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1257 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:42.921926 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-11f0b84b-0fca-4baf-a263-9f9f53404ba6 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:42.933465 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-11f0b84b-0fca-4baf-a263-9f9f53404ba6 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:42.939007 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-11f0b84b-0fca-4baf-a263-9f9f53404ba6 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:42.942008 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-11f0b84b-0fca-4baf-a263-9f9f53404ba6 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1806 microversion: 2.20 time: 0.404831 Jul 12 17:42:42.943113 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 221/462] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:42 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1806 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:42:43.077712 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-d09ddfe1-1171-4fc5-a737-8feb39638e33 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:43.079181 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-d09ddfe1-1171-4fc5-a737-8feb39638e33 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:43.092425 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d09ddfe1-1171-4fc5-a737-8feb39638e33 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:43.094559 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d09ddfe1-1171-4fc5-a737-8feb39638e33 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:43.096985 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d09ddfe1-1171-4fc5-a737-8feb39638e33 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:43.097797 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d09ddfe1-1171-4fc5-a737-8feb39638e33 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:43.225050 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-763c135e-be06-48fc-ba43-8f0b3cb59d5a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:43.225667 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-763c135e-be06-48fc-ba43-8f0b3cb59d5a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:43.250925 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-763c135e-be06-48fc-ba43-8f0b3cb59d5a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:43.255947 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-763c135e-be06-48fc-ba43-8f0b3cb59d5a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:43.255947 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-763c135e-be06-48fc-ba43-8f0b3cb59d5a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:43.255947 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-763c135e-be06-48fc-ba43-8f0b3cb59d5a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:43.333364 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-763c135e-be06-48fc-ba43-8f0b3cb59d5a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:43.333837 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-763c135e-be06-48fc-ba43-8f0b3cb59d5a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:43.334313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.objects.instance [None req-763c135e-be06-48fc-ba43-8f0b3cb59d5a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lazy-loading 'fault' on Instance uuid dfbdba37-86d8-477a-95a8-9bef8b6df8dd {{(pid=130058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:42:43.411475 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-763c135e-be06-48fc-ba43-8f0b3cb59d5a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:43.421075 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-763c135e-be06-48fc-ba43-8f0b3cb59d5a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd" status: 200 len: 1331 microversion: 2.1 time: 0.202536 Jul 12 17:42:43.421869 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 222/463] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:43 2022] GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd => generated 1331 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:43.448300 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-5a90c84a-dddb-452e-bcee-4e026525a35c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:43.451665 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-5a90c84a-dddb-452e-bcee-4e026525a35c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:43.451816 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-d09ddfe1-1171-4fc5-a737-8feb39638e33 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:43.466322 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5a90c84a-dddb-452e-bcee-4e026525a35c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:43.467226 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5a90c84a-dddb-452e-bcee-4e026525a35c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:43.468187 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5a90c84a-dddb-452e-bcee-4e026525a35c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:43.471444 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-d09ddfe1-1171-4fc5-a737-8feb39638e33 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1267 microversion: 2.1 time: 0.399720 Jul 12 17:42:43.472118 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 242/464] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:43 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1267 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:43.472549 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5a90c84a-dddb-452e-bcee-4e026525a35c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:43.814637 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-782a5dc3-4884-4c20-a71a-4405d4a4739d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:43.815259 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-782a5dc3-4884-4c20-a71a-4405d4a4739d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:43.842598 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-5a90c84a-dddb-452e-bcee-4e026525a35c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:43.844299 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-782a5dc3-4884-4c20-a71a-4405d4a4739d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:43.845052 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-782a5dc3-4884-4c20-a71a-4405d4a4739d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:43.848485 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-782a5dc3-4884-4c20-a71a-4405d4a4739d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:43.848947 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-782a5dc3-4884-4c20-a71a-4405d4a4739d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:43.861636 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-5a90c84a-dddb-452e-bcee-4e026525a35c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1314 microversion: 2.1 time: 0.428986 Jul 12 17:42:43.874749 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 223/465] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:43 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:43.962040 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-0bf1af78-898e-4bcd-89ee-dfd18bfd4c5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:43.963568 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-0bf1af78-898e-4bcd-89ee-dfd18bfd4c5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:43.998299 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0bf1af78-898e-4bcd-89ee-dfd18bfd4c5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:43.998787 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0bf1af78-898e-4bcd-89ee-dfd18bfd4c5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:44.010368 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0bf1af78-898e-4bcd-89ee-dfd18bfd4c5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:44.011353 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0bf1af78-898e-4bcd-89ee-dfd18bfd4c5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:44.046975 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-782a5dc3-4884-4c20-a71a-4405d4a4739d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:44.075502 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-782a5dc3-4884-4c20-a71a-4405d4a4739d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1253 microversion: 2.1 time: 0.261522 Jul 12 17:42:44.076192 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 243/466] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:43 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1253 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:42:44.365906 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-8d0270e3-8632-463a-8e5d-89355147170a req-911f5f3b-f0ef-4e9b-a5b6-d4051d5f5367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73d03675-d5c4-4778-a9c2-320d010588b7", "name": "network-vif-plugged", "status": "completed", "tag": "9dd6e257-1f75-4cdb-b508-53b460481a96"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:42:44.384495 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-8d0270e3-8632-463a-8e5d-89355147170a req-911f5f3b-f0ef-4e9b-a5b6-d4051d5f5367 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:44.384495 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-8d0270e3-8632-463a-8e5d-89355147170a req-911f5f3b-f0ef-4e9b-a5b6-d4051d5f5367 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:44.426102 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-8d0270e3-8632-463a-8e5d-89355147170a req-911f5f3b-f0ef-4e9b-a5b6-d4051d5f5367 service nova] Creating event network-vif-plugged:9dd6e257-1f75-4cdb-b508-53b460481a96 for instance 73d03675-d5c4-4778-a9c2-320d010588b7 on hv-cinder-84875 Jul 12 17:42:44.433835 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-8d0270e3-8632-463a-8e5d-89355147170a req-911f5f3b-f0ef-4e9b-a5b6-d4051d5f5367 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077748 Jul 12 17:42:44.441330 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 244/467] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:42:44.447705 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-f99d8107-385f-4b10-8a74-89a41ccec61d req-53a31b36-4432-476b-a0b7-fa09b48c0001 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e97f8453-690a-4d27-8061-81007783d32a", "tag": "6a7159ad-dc9e-4e19-93f7-f60cb2d94a73"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:42:44.470692 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-f99d8107-385f-4b10-8a74-89a41ccec61d req-53a31b36-4432-476b-a0b7-fa09b48c0001 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:44.471315 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-f99d8107-385f-4b10-8a74-89a41ccec61d req-53a31b36-4432-476b-a0b7-fa09b48c0001 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:44.488770 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-f99d8107-385f-4b10-8a74-89a41ccec61d req-53a31b36-4432-476b-a0b7-fa09b48c0001 service nova] Creating event network-changed:6a7159ad-dc9e-4e19-93f7-f60cb2d94a73 for instance e97f8453-690a-4d27-8061-81007783d32a on hv-cinder-84875 Jul 12 17:42:44.498712 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-f99d8107-385f-4b10-8a74-89a41ccec61d req-53a31b36-4432-476b-a0b7-fa09b48c0001 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054957 Jul 12 17:42:44.500334 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 245/468] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:42:44.508135 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-67990c51-ce3f-4739-b3fd-622a1a67c464 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:44.509301 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-67990c51-ce3f-4739-b3fd-622a1a67c464 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:44.518567 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-67990c51-ce3f-4739-b3fd-622a1a67c464 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:44.519403 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-67990c51-ce3f-4739-b3fd-622a1a67c464 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:44.520562 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-67990c51-ce3f-4739-b3fd-622a1a67c464 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:44.521384 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-67990c51-ce3f-4739-b3fd-622a1a67c464 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:44.553488 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-67990c51-ce3f-4739-b3fd-622a1a67c464 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] HTTP exception thrown: Instance dfbdba37-86d8-477a-95a8-9bef8b6df8dd could not be found. Jul 12 17:42:44.557981 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-67990c51-ce3f-4739-b3fd-622a1a67c464 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Request method failure captured: Jul 12 17:42:44.557981 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd HTTP/1.1 Jul 12 17:42:44.557981 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:42:44.557981 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:42:44.557981 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:42:44.557981 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 0 Jul 12 17:42:44.557981 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:42:44.557981 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:42:44.557981 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:42:44.557981 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:42:44.557981 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbHIKPX81cOSzuTp0O3vMBUQ_2pscgJx1VEp1s8R65yvOz2oUKOjUaqFlJmNQdapSExRqaTx7so1aRxIG_vuYNvJ_o-Kb6m698uGIk6QmB9ep_Ed50ORq5_o-D700OCaKd2Eu3BHwptAzFT8ZMufAhu8lzyW1do401lCvRn-uiuATyM Jul 12 17:42:44.557981 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:42:44.557981 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:42:44.557981 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:42:44.557981 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:42:44.557981 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:42:44.557981 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:42:44.557981 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: 84b840eaa59d4f73ac68926437f03d82 Jul 12 17:42:44.557981 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:42:44.557981 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:42:44.557981 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:42:44.559695 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84b840eaa59d4f73ac68926437f03d82", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:42:44.559695 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:42:44.559695 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: 84b840eaa59d4f73ac68926437f03d82 Jul 12 17:42:44.559695 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:42:44.559695 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-AttachVolumeNegativeTest-834922830-project Jul 12 17:42:44.559695 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:42:44.559695 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:42:44.559695 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: c8441a4a72154ee3bbb95af66abf2ffd Jul 12 17:42:44.559695 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-AttachVolumeNegativeTest-834922830-project Jul 12 17:42:44.559695 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: > Jul 12 17:42:44.559695 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Instance dfbdba37-86d8-477a-95a8-9bef8b6df8dd could not be found. Jul 12 17:42:44.559695 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'id': 'dfbdba37-86d8-477a-95a8-9bef8b6df8dd'} Jul 12 17:42:44.560588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:42:44.560588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:42:44.560588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:42:44.560588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:42:44.560588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:42:44.560588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:42:44.560588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:42:44.560588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:42:44.560588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:42:44.560588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:42:44.560588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfbdba37-86d8-477a-95a8-9bef8b6df8dd could not be found. Jul 12 17:42:44.560588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:42:44.560588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:42:44.560588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:42:44.560588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:42:44.560588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:42:44.560588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:42:44.560588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:42:44.560588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:42:44.560588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:42:44.562022 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:42:44.562022 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:42:44.562022 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:42:44.562022 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:42:44.562022 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:42:44.562022 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:42:44.562022 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:42:44.562022 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfbdba37-86d8-477a-95a8-9bef8b6df8dd could not be found. Jul 12 17:42:44.562022 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:42:44.562022 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:42:44.562022 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:42:44.562022 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:42:44.562022 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:42:44.562022 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:42:44.562022 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:42:44.562022 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:42:44.562022 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfbdba37-86d8-477a-95a8-9bef8b6df8dd could not be found. Jul 12 17:42:44.562022 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:42:44.567195 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-67990c51-ce3f-4739-b3fd-622a1a67c464 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Returning 404 to user: Instance dfbdba37-86d8-477a-95a8-9bef8b6df8dd could not be found. {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:42:44.568434 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-67990c51-ce3f-4739-b3fd-622a1a67c464 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd" status: 404 len: 111 microversion: 2.1 time: 0.066171 Jul 12 17:42:44.570615 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 246/469] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:44 2022] GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:42:44.583387 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-71198236-8601-4389-a444-e77905611f1d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:44.584429 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-71198236-8601-4389-a444-e77905611f1d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:44.605316 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0bf1af78-898e-4bcd-89ee-dfd18bfd4c5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:44.606417 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-71198236-8601-4389-a444-e77905611f1d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:44.606917 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-71198236-8601-4389-a444-e77905611f1d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:44.607787 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-71198236-8601-4389-a444-e77905611f1d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:44.608241 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-71198236-8601-4389-a444-e77905611f1d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:44.617089 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0bf1af78-898e-4bcd-89ee-dfd18bfd4c5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:44.628188 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0bf1af78-898e-4bcd-89ee-dfd18bfd4c5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:44.636689 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-0bf1af78-898e-4bcd-89ee-dfd18bfd4c5e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1806 microversion: 2.20 time: 0.676991 Jul 12 17:42:44.650375 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 224/470] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:43 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1806 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:42:44.657806 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-4657dd8c-813b-4d8b-b722-4be8bd182050 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '.version_select at 0x7f479fe5f9d0>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:44.756879 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-4657dd8c-813b-4d8b-b722-4be8bd182050 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2127514372" status: 202 len: 0 microversion: 2.1 time: 0.111267 Jul 12 17:42:44.758335 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 225/471] 10.222.0.16 () {58 vars in 1220 bytes} [Tue Jul 12 17:42:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2127514372 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:42:44.884451 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-8c2017ea-baf6-4c0c-97a3-b58a5a37fe74 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:44.885098 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-8c2017ea-baf6-4c0c-97a3-b58a5a37fe74 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:44.896825 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-71198236-8601-4389-a444-e77905611f1d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:44.897571 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8c2017ea-baf6-4c0c-97a3-b58a5a37fe74 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:44.898033 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8c2017ea-baf6-4c0c-97a3-b58a5a37fe74 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:44.898852 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8c2017ea-baf6-4c0c-97a3-b58a5a37fe74 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:44.905367 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8c2017ea-baf6-4c0c-97a3-b58a5a37fe74 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:44.908253 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-71198236-8601-4389-a444-e77905611f1d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1267 microversion: 2.1 time: 0.336037 Jul 12 17:42:44.913640 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 247/472] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:44 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1267 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:45.096720 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-02a8017e-8618-4c81-bbb3-ba823461adf3 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:45.099161 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-02a8017e-8618-4c81-bbb3-ba823461adf3 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:45.138895 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-02a8017e-8618-4c81-bbb3-ba823461adf3 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:45.138895 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-02a8017e-8618-4c81-bbb3-ba823461adf3 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:45.138895 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-02a8017e-8618-4c81-bbb3-ba823461adf3 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:45.138895 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-02a8017e-8618-4c81-bbb3-ba823461adf3 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:45.149047 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-8c2017ea-baf6-4c0c-97a3-b58a5a37fe74 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:45.157887 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-8c2017ea-baf6-4c0c-97a3-b58a5a37fe74 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1314 microversion: 2.1 time: 0.278831 Jul 12 17:42:45.158796 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 226/473] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:44 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:42:45.240464 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-02a8017e-8618-4c81-bbb3-ba823461adf3 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:45.245532 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:42:45.259315 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-02a8017e-8618-4c81-bbb3-ba823461adf3 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1309 microversion: 2.1 time: 0.162530 Jul 12 17:42:45.259315 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 248/474] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:45 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1309 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:45.658114 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-fd7f5cab-5209-4f53-8666-bc71d640bf0e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:45.658879 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-fd7f5cab-5209-4f53-8666-bc71d640bf0e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:45.682607 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fd7f5cab-5209-4f53-8666-bc71d640bf0e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:45.683198 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fd7f5cab-5209-4f53-8666-bc71d640bf0e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:45.684294 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fd7f5cab-5209-4f53-8666-bc71d640bf0e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:45.684700 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fd7f5cab-5209-4f53-8666-bc71d640bf0e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:45.870602 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-fd7f5cab-5209-4f53-8666-bc71d640bf0e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:45.880821 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-fd7f5cab-5209-4f53-8666-bc71d640bf0e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:45.882369 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-fd7f5cab-5209-4f53-8666-bc71d640bf0e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:45.883639 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-fd7f5cab-5209-4f53-8666-bc71d640bf0e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1806 microversion: 2.20 time: 0.230399 Jul 12 17:42:45.895173 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 227/475] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:45 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1806 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:42:45.931437 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-6caeb81c-5262-4a27-8e66-75cebebd594e tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:45.932848 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-6caeb81c-5262-4a27-8e66-75cebebd594e tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:45.940654 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6caeb81c-5262-4a27-8e66-75cebebd594e tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:45.941351 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6caeb81c-5262-4a27-8e66-75cebebd594e tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:45.945178 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6caeb81c-5262-4a27-8e66-75cebebd594e tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:45.945178 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6caeb81c-5262-4a27-8e66-75cebebd594e tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:46.180773 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-f3d8c1e2-ca80-4c40-a0d0-7b6a55843774 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:46.187615 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-f3d8c1e2-ca80-4c40-a0d0-7b6a55843774 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:46.208059 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f3d8c1e2-ca80-4c40-a0d0-7b6a55843774 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:46.212550 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f3d8c1e2-ca80-4c40-a0d0-7b6a55843774 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:46.216193 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f3d8c1e2-ca80-4c40-a0d0-7b6a55843774 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:46.219533 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f3d8c1e2-ca80-4c40-a0d0-7b6a55843774 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:46.296380 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-6caeb81c-5262-4a27-8e66-75cebebd594e tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:46.322705 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-6caeb81c-5262-4a27-8e66-75cebebd594e tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1267 microversion: 2.1 time: 0.395164 Jul 12 17:42:46.326189 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 249/476] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:45 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1267 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:46.374002 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-6fb4d870-8194-417c-8c6b-30e9ee44f964 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:46.383130 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-6fb4d870-8194-417c-8c6b-30e9ee44f964 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:46.400791 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6fb4d870-8194-417c-8c6b-30e9ee44f964 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:46.401937 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6fb4d870-8194-417c-8c6b-30e9ee44f964 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:46.403770 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6fb4d870-8194-417c-8c6b-30e9ee44f964 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:46.405710 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6fb4d870-8194-417c-8c6b-30e9ee44f964 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:46.523509 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-6fb4d870-8194-417c-8c6b-30e9ee44f964 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:46.532969 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-6fb4d870-8194-417c-8c6b-30e9ee44f964 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1317 microversion: 2.1 time: 0.204407 Jul 12 17:42:46.534566 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 250/477] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:46 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:46.551022 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-83d4f2c0-a4f6-44b8-b050-a83844f15d98 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:46.551962 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-83d4f2c0-a4f6-44b8-b050-a83844f15d98 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:46.556035 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-f3d8c1e2-ca80-4c40-a0d0-7b6a55843774 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:46.559172 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-83d4f2c0-a4f6-44b8-b050-a83844f15d98 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:46.560011 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-83d4f2c0-a4f6-44b8-b050-a83844f15d98 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:46.561062 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-83d4f2c0-a4f6-44b8-b050-a83844f15d98 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:46.561564 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-83d4f2c0-a4f6-44b8-b050-a83844f15d98 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:46.570568 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-f3d8c1e2-ca80-4c40-a0d0-7b6a55843774 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1314 microversion: 2.1 time: 0.397756 Jul 12 17:42:46.572603 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 228/478] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:46 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:46.752951 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.objects.instance [None req-83d4f2c0-a4f6-44b8-b050-a83844f15d98 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lazy-loading 'services' on Instance uuid edf55e8a-cbc1-45b6-a138-21d5a07301d9 {{(pid=130059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:42:46.904776 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-cd2359bc-3230-43fa-839e-bb5f189deaf3 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:46.906039 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-cd2359bc-3230-43fa-839e-bb5f189deaf3 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:46.915145 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cd2359bc-3230-43fa-839e-bb5f189deaf3 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:46.924372 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cd2359bc-3230-43fa-839e-bb5f189deaf3 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:46.924372 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cd2359bc-3230-43fa-839e-bb5f189deaf3 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:46.924372 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cd2359bc-3230-43fa-839e-bb5f189deaf3 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:47.120897 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-cd2359bc-3230-43fa-839e-bb5f189deaf3 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:47.128712 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-cd2359bc-3230-43fa-839e-bb5f189deaf3 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:47.131291 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-cd2359bc-3230-43fa-839e-bb5f189deaf3 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:47.132766 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-cd2359bc-3230-43fa-839e-bb5f189deaf3 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1806 microversion: 2.20 time: 0.232502 Jul 12 17:42:47.133421 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 229/479] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:46 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1806 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:42:47.357534 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-47d9728b-2917-4289-bbe9-18c548e4b2d4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:47.358142 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-47d9728b-2917-4289-bbe9-18c548e4b2d4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:47.365368 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-47d9728b-2917-4289-bbe9-18c548e4b2d4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:47.366171 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-47d9728b-2917-4289-bbe9-18c548e4b2d4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:47.367388 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-47d9728b-2917-4289-bbe9-18c548e4b2d4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:47.368060 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-47d9728b-2917-4289-bbe9-18c548e4b2d4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:47.533776 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-47d9728b-2917-4289-bbe9-18c548e4b2d4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:47.569528 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-83d4f2c0-a4f6-44b8-b050-a83844f15d98 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "DELETE /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments/a75ab260-fa20-4bc4-ba8b-e43b3b07b894" status: 202 len: 0 microversion: 2.1 time: 1.003408 Jul 12 17:42:47.569528 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 251/480] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jul 12 17:42:46 2022] DELETE /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments/a75ab260-fa20-4bc4-ba8b-e43b3b07b894 => generated 0 bytes in 1005 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:42:47.570342 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-47d9728b-2917-4289-bbe9-18c548e4b2d4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1267 microversion: 2.1 time: 0.189115 Jul 12 17:42:47.570342 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 230/481] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:47 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:42:47.570576 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-bdd0638b-9ea6-471b-bf06-a8892b8a23e9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:47.570576 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-bdd0638b-9ea6-471b-bf06-a8892b8a23e9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:47.579562 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bdd0638b-9ea6-471b-bf06-a8892b8a23e9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:47.580217 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bdd0638b-9ea6-471b-bf06-a8892b8a23e9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:47.585691 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bdd0638b-9ea6-471b-bf06-a8892b8a23e9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:47.586734 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bdd0638b-9ea6-471b-bf06-a8892b8a23e9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:47.591767 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-51323a4e-c8b4-41aa-9ccf-7336744045bc tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:47.592762 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-51323a4e-c8b4-41aa-9ccf-7336744045bc tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:47.599338 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-51323a4e-c8b4-41aa-9ccf-7336744045bc tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:47.599788 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-51323a4e-c8b4-41aa-9ccf-7336744045bc tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:47.600694 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-51323a4e-c8b4-41aa-9ccf-7336744045bc tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:47.601130 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-51323a4e-c8b4-41aa-9ccf-7336744045bc tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:47.636996 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=100 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:42:47.647596 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-51323a4e-c8b4-41aa-9ccf-7336744045bc tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070364 Jul 12 17:42:47.648489 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 231/482] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:42:47 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:42:47.653433 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-dc6aa161-a00d-4f72-90fc-4e94564a3782 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:47.654039 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-dc6aa161-a00d-4f72-90fc-4e94564a3782 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:47.662259 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-dc6aa161-a00d-4f72-90fc-4e94564a3782 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:47.662740 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-dc6aa161-a00d-4f72-90fc-4e94564a3782 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:47.663533 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-dc6aa161-a00d-4f72-90fc-4e94564a3782 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:47.663975 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-dc6aa161-a00d-4f72-90fc-4e94564a3782 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:47.704106 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-bdd0638b-9ea6-471b-bf06-a8892b8a23e9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:47.715160 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-bdd0638b-9ea6-471b-bf06-a8892b8a23e9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1317 microversion: 2.1 time: 0.159168 Jul 12 17:42:47.716126 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 252/483] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:47 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:47.883157 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-dc6aa161-a00d-4f72-90fc-4e94564a3782 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:47.883157 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-dc6aa161-a00d-4f72-90fc-4e94564a3782 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1314 microversion: 2.1 time: 0.231966 Jul 12 17:42:47.883157 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 232/484] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:47 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:48.152812 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-8af71dd7-f937-4531-86c8-dc8d3e8cc6fc tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:48.153981 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-8af71dd7-f937-4531-86c8-dc8d3e8cc6fc tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:48.161772 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8af71dd7-f937-4531-86c8-dc8d3e8cc6fc tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:48.162331 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8af71dd7-f937-4531-86c8-dc8d3e8cc6fc tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:48.163152 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8af71dd7-f937-4531-86c8-dc8d3e8cc6fc tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:48.163815 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8af71dd7-f937-4531-86c8-dc8d3e8cc6fc tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:48.316525 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-8af71dd7-f937-4531-86c8-dc8d3e8cc6fc tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:48.326457 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-8af71dd7-f937-4531-86c8-dc8d3e8cc6fc tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:48.328045 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-8af71dd7-f937-4531-86c8-dc8d3e8cc6fc tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:48.329548 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-8af71dd7-f937-4531-86c8-dc8d3e8cc6fc tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1806 microversion: 2.20 time: 0.180669 Jul 12 17:42:48.330113 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 253/485] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:48 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1806 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:42:48.700452 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-4de3d35d-c591-46b1-be3b-751a1c6aaf41 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:48.700452 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-4de3d35d-c591-46b1-be3b-751a1c6aaf41 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:48.700452 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:42:48.700452 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4de3d35d-c591-46b1-be3b-751a1c6aaf41 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:48.703346 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4de3d35d-c591-46b1-be3b-751a1c6aaf41 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:48.703346 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4de3d35d-c591-46b1-be3b-751a1c6aaf41 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:48.703346 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4de3d35d-c591-46b1-be3b-751a1c6aaf41 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:48.703614 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-004fe8df-ce11-4941-a37d-d63d107afb2c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:48.703614 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-004fe8df-ce11-4941-a37d-d63d107afb2c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:48.703614 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-004fe8df-ce11-4941-a37d-d63d107afb2c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:48.703614 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-004fe8df-ce11-4941-a37d-d63d107afb2c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:48.704337 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-004fe8df-ce11-4941-a37d-d63d107afb2c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:48.704337 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-004fe8df-ce11-4941-a37d-d63d107afb2c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:48.729869 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-004fe8df-ce11-4941-a37d-d63d107afb2c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073850 Jul 12 17:42:48.730639 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 254/486] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:42:48 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:42:48.735917 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-118f0355-929a-42d6-904e-151729cc1454 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:48.736630 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-118f0355-929a-42d6-904e-151729cc1454 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:48.745721 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-118f0355-929a-42d6-904e-151729cc1454 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:48.746180 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-118f0355-929a-42d6-904e-151729cc1454 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:48.747086 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-118f0355-929a-42d6-904e-151729cc1454 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:48.747559 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-118f0355-929a-42d6-904e-151729cc1454 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:48.809663 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-4de3d35d-c591-46b1-be3b-751a1c6aaf41 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:48.826612 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-4de3d35d-c591-46b1-be3b-751a1c6aaf41 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1267 microversion: 2.1 time: 0.241006 Jul 12 17:42:48.827434 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 233/487] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:48 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1267 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:48.862377 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-118f0355-929a-42d6-904e-151729cc1454 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:48.871275 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-118f0355-929a-42d6-904e-151729cc1454 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1317 microversion: 2.1 time: 0.139618 Jul 12 17:42:48.882503 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 255/488] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:48 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:48.908486 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-f6d6a420-bcea-413c-99d7-239041907514 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:48.909905 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-f6d6a420-bcea-413c-99d7-239041907514 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:48.925208 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f6d6a420-bcea-413c-99d7-239041907514 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:48.925807 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f6d6a420-bcea-413c-99d7-239041907514 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:48.926759 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f6d6a420-bcea-413c-99d7-239041907514 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:48.927300 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f6d6a420-bcea-413c-99d7-239041907514 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:49.095778 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-f6d6a420-bcea-413c-99d7-239041907514 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:49.104206 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-f6d6a420-bcea-413c-99d7-239041907514 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1314 microversion: 2.1 time: 0.206491 Jul 12 17:42:49.105107 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 234/489] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:48 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:42:49.367451 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-e9a9f90c-d0a9-4e22-8e5c-63e0c98d10f5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:49.368122 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-e9a9f90c-d0a9-4e22-8e5c-63e0c98d10f5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:49.376213 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e9a9f90c-d0a9-4e22-8e5c-63e0c98d10f5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:49.376670 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e9a9f90c-d0a9-4e22-8e5c-63e0c98d10f5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:49.377452 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e9a9f90c-d0a9-4e22-8e5c-63e0c98d10f5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:49.377951 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e9a9f90c-d0a9-4e22-8e5c-63e0c98d10f5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:49.533609 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-e9a9f90c-d0a9-4e22-8e5c-63e0c98d10f5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:49.559698 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-e9a9f90c-d0a9-4e22-8e5c-63e0c98d10f5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:49.561491 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-e9a9f90c-d0a9-4e22-8e5c-63e0c98d10f5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:49.562818 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-e9a9f90c-d0a9-4e22-8e5c-63e0c98d10f5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1806 microversion: 2.20 time: 0.200497 Jul 12 17:42:49.565545 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 256/490] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:49 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1806 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:42:49.742336 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-e0f047b2-f6db-468e-8f9f-0c9543653af8 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:49.743363 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-e0f047b2-f6db-468e-8f9f-0c9543653af8 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:49.750249 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e0f047b2-f6db-468e-8f9f-0c9543653af8 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:49.750858 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e0f047b2-f6db-468e-8f9f-0c9543653af8 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:49.752429 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e0f047b2-f6db-468e-8f9f-0c9543653af8 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:49.752853 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e0f047b2-f6db-468e-8f9f-0c9543653af8 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:49.785202 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-e0f047b2-f6db-468e-8f9f-0c9543653af8 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047235 Jul 12 17:42:49.785789 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 235/491] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:42:49 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:42:49.852313 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-8db4e189-82c2-49f3-8321-60c6bb1cc5c2 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:49.852946 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-8db4e189-82c2-49f3-8321-60c6bb1cc5c2 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:49.859582 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8db4e189-82c2-49f3-8321-60c6bb1cc5c2 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:49.860037 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8db4e189-82c2-49f3-8321-60c6bb1cc5c2 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:49.861433 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8db4e189-82c2-49f3-8321-60c6bb1cc5c2 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:49.861887 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8db4e189-82c2-49f3-8321-60c6bb1cc5c2 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:49.890331 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-e35e8bd9-902f-4222-a332-4062c22f6d6e tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:49.891005 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-e35e8bd9-902f-4222-a332-4062c22f6d6e tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:49.897857 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e35e8bd9-902f-4222-a332-4062c22f6d6e tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:49.898331 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e35e8bd9-902f-4222-a332-4062c22f6d6e tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:49.902177 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e35e8bd9-902f-4222-a332-4062c22f6d6e tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:49.902901 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e35e8bd9-902f-4222-a332-4062c22f6d6e tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:49.987402 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-e35e8bd9-902f-4222-a332-4062c22f6d6e tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:49.995579 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-e35e8bd9-902f-4222-a332-4062c22f6d6e tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1317 microversion: 2.1 time: 0.109111 Jul 12 17:42:49.996104 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 236/492] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:49 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1317 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:50.027939 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-8db4e189-82c2-49f3-8321-60c6bb1cc5c2 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:50.038468 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-8db4e189-82c2-49f3-8321-60c6bb1cc5c2 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1267 microversion: 2.1 time: 0.190066 Jul 12 17:42:50.039551 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 257/493] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:49 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:50.121853 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-efd47dd5-4b23-4698-ac05-50a4cd881f19 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:50.122503 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-efd47dd5-4b23-4698-ac05-50a4cd881f19 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:50.129149 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-efd47dd5-4b23-4698-ac05-50a4cd881f19 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:50.129603 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-efd47dd5-4b23-4698-ac05-50a4cd881f19 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:50.130410 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-efd47dd5-4b23-4698-ac05-50a4cd881f19 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:50.130970 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-efd47dd5-4b23-4698-ac05-50a4cd881f19 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:50.289013 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-efd47dd5-4b23-4698-ac05-50a4cd881f19 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:50.296933 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-efd47dd5-4b23-4698-ac05-50a4cd881f19 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1314 microversion: 2.1 time: 0.179563 Jul 12 17:42:50.298912 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 237/494] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:50 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:50.586862 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-5ae97fcc-8113-44e4-b3dc-7866129f0a87 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:50.587708 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-5ae97fcc-8113-44e4-b3dc-7866129f0a87 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:50.604046 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5ae97fcc-8113-44e4-b3dc-7866129f0a87 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:50.604607 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5ae97fcc-8113-44e4-b3dc-7866129f0a87 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:50.605539 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5ae97fcc-8113-44e4-b3dc-7866129f0a87 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:50.606318 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5ae97fcc-8113-44e4-b3dc-7866129f0a87 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:50.770043 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-5ae97fcc-8113-44e4-b3dc-7866129f0a87 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:50.787556 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-5ae97fcc-8113-44e4-b3dc-7866129f0a87 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:50.789320 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-5ae97fcc-8113-44e4-b3dc-7866129f0a87 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:50.797529 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-464d4356-c4e5-402e-b78e-5b093e5311d2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:50.798688 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-464d4356-c4e5-402e-b78e-5b093e5311d2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:50.802793 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-5ae97fcc-8113-44e4-b3dc-7866129f0a87 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1806 microversion: 2.20 time: 0.209772 Jul 12 17:42:50.803471 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 258/495] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:50 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1806 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:42:50.806068 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-464d4356-c4e5-402e-b78e-5b093e5311d2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:50.806568 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-464d4356-c4e5-402e-b78e-5b093e5311d2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:50.807366 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-464d4356-c4e5-402e-b78e-5b093e5311d2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:50.807816 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-464d4356-c4e5-402e-b78e-5b093e5311d2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:50.855085 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-464d4356-c4e5-402e-b78e-5b093e5311d2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061131 Jul 12 17:42:50.855923 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 238/496] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:42:50 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:42:51.013214 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-9a930862-2ffa-4af9-a538-f7dd44ca7643 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:51.013822 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-9a930862-2ffa-4af9-a538-f7dd44ca7643 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:51.021765 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9a930862-2ffa-4af9-a538-f7dd44ca7643 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:51.022270 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9a930862-2ffa-4af9-a538-f7dd44ca7643 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:51.023163 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9a930862-2ffa-4af9-a538-f7dd44ca7643 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:51.023612 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9a930862-2ffa-4af9-a538-f7dd44ca7643 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:51.056247 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-c135953f-4256-483d-aaa8-2090c43e3450 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:51.056882 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-c135953f-4256-483d-aaa8-2090c43e3450 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:51.064866 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c135953f-4256-483d-aaa8-2090c43e3450 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:51.065322 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c135953f-4256-483d-aaa8-2090c43e3450 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:51.066356 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c135953f-4256-483d-aaa8-2090c43e3450 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:51.066824 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c135953f-4256-483d-aaa8-2090c43e3450 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:51.108328 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-9a930862-2ffa-4af9-a538-f7dd44ca7643 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:51.116915 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-9a930862-2ffa-4af9-a538-f7dd44ca7643 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1317 microversion: 2.1 time: 0.107547 Jul 12 17:42:51.118105 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 259/497] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:51 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1317 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:51.274489 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-c135953f-4256-483d-aaa8-2090c43e3450 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:51.282869 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-c135953f-4256-483d-aaa8-2090c43e3450 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1267 microversion: 2.1 time: 0.230100 Jul 12 17:42:51.283665 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 239/498] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:51 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1267 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:51.315790 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-af3cb042-6095-4f12-9935-31796f7d2a18 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:51.316698 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-af3cb042-6095-4f12-9935-31796f7d2a18 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:51.323419 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell0:SELECT=2 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:42:51.330478 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-af3cb042-6095-4f12-9935-31796f7d2a18 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:51.330478 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-af3cb042-6095-4f12-9935-31796f7d2a18 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:51.330478 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-af3cb042-6095-4f12-9935-31796f7d2a18 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:51.330478 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-af3cb042-6095-4f12-9935-31796f7d2a18 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:51.486627 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-af3cb042-6095-4f12-9935-31796f7d2a18 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:51.495330 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-af3cb042-6095-4f12-9935-31796f7d2a18 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1314 microversion: 2.1 time: 0.183653 Jul 12 17:42:51.496105 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 260/499] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:51 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:51.825945 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-a1c43899-c9a7-4c05-937a-bbed0f03e4d0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:51.826687 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-a1c43899-c9a7-4c05-937a-bbed0f03e4d0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:51.834715 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a1c43899-c9a7-4c05-937a-bbed0f03e4d0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:51.835082 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a1c43899-c9a7-4c05-937a-bbed0f03e4d0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:51.835871 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a1c43899-c9a7-4c05-937a-bbed0f03e4d0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:51.836313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a1c43899-c9a7-4c05-937a-bbed0f03e4d0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:51.867005 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-78a02656-2b8b-485f-a12c-35769f02a880 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:51.868089 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-78a02656-2b8b-485f-a12c-35769f02a880 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:51.875280 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-78a02656-2b8b-485f-a12c-35769f02a880 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:51.876407 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-78a02656-2b8b-485f-a12c-35769f02a880 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:51.877320 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-78a02656-2b8b-485f-a12c-35769f02a880 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:51.877922 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-78a02656-2b8b-485f-a12c-35769f02a880 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:51.926102 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-78a02656-2b8b-485f-a12c-35769f02a880 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062906 Jul 12 17:42:51.931513 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 261/500] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:42:51 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:42:51.992349 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-a1c43899-c9a7-4c05-937a-bbed0f03e4d0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:52.002706 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-a1c43899-c9a7-4c05-937a-bbed0f03e4d0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:52.004596 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-a1c43899-c9a7-4c05-937a-bbed0f03e4d0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:52.005827 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-a1c43899-c9a7-4c05-937a-bbed0f03e4d0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1806 microversion: 2.20 time: 0.188104 Jul 12 17:42:52.006449 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 240/501] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:51 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1806 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:42:52.136618 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-9224241e-3629-4c86-a9d8-2e0bc19bff77 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:52.137789 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-9224241e-3629-4c86-a9d8-2e0bc19bff77 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:52.154227 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9224241e-3629-4c86-a9d8-2e0bc19bff77 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:52.154850 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9224241e-3629-4c86-a9d8-2e0bc19bff77 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:52.155790 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9224241e-3629-4c86-a9d8-2e0bc19bff77 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:52.156333 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9224241e-3629-4c86-a9d8-2e0bc19bff77 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:52.222358 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-9224241e-3629-4c86-a9d8-2e0bc19bff77 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:52.230922 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-9224241e-3629-4c86-a9d8-2e0bc19bff77 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1317 microversion: 2.1 time: 0.099354 Jul 12 17:42:52.231793 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 262/502] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:52 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1317 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:42:52.299925 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-1fc1a79e-dcf5-48c7-b858-c3421b59dd29 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:52.300563 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-1fc1a79e-dcf5-48c7-b858-c3421b59dd29 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:52.307919 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1fc1a79e-dcf5-48c7-b858-c3421b59dd29 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:52.308377 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1fc1a79e-dcf5-48c7-b858-c3421b59dd29 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:52.309191 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1fc1a79e-dcf5-48c7-b858-c3421b59dd29 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:52.309630 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1fc1a79e-dcf5-48c7-b858-c3421b59dd29 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:52.482536 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-1fc1a79e-dcf5-48c7-b858-c3421b59dd29 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:52.493022 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-1fc1a79e-dcf5-48c7-b858-c3421b59dd29 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1267 microversion: 2.1 time: 0.196933 Jul 12 17:42:52.493631 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 241/503] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:52 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:52.514008 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a739c9ed-68e8-4251-acea-44824513386c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:52.514755 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-a739c9ed-68e8-4251-acea-44824513386c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:52.521561 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a739c9ed-68e8-4251-acea-44824513386c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:52.522153 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a739c9ed-68e8-4251-acea-44824513386c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:52.523048 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a739c9ed-68e8-4251-acea-44824513386c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:52.523829 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a739c9ed-68e8-4251-acea-44824513386c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:52.680411 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a739c9ed-68e8-4251-acea-44824513386c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:52.693741 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-a739c9ed-68e8-4251-acea-44824513386c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1314 microversion: 2.1 time: 0.184394 Jul 12 17:42:52.704718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 263/504] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:52 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:52.939104 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-3d1e814e-f91f-4d66-9926-528ca49e551b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:52.940098 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-3d1e814e-f91f-4d66-9926-528ca49e551b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:52.947587 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3d1e814e-f91f-4d66-9926-528ca49e551b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:52.949831 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3d1e814e-f91f-4d66-9926-528ca49e551b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:52.950724 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3d1e814e-f91f-4d66-9926-528ca49e551b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:52.951220 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3d1e814e-f91f-4d66-9926-528ca49e551b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:52.986300 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-3d1e814e-f91f-4d66-9926-528ca49e551b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052066 Jul 12 17:42:52.986939 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 242/505] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:42:52 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:42:53.023860 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-820bfe5f-51e9-480a-b80c-613a9d5cdd25 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:53.024576 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-820bfe5f-51e9-480a-b80c-613a9d5cdd25 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:53.030702 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell0:SELECT=14 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:42:53.034791 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-820bfe5f-51e9-480a-b80c-613a9d5cdd25 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:53.035387 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-820bfe5f-51e9-480a-b80c-613a9d5cdd25 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:53.036457 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-820bfe5f-51e9-480a-b80c-613a9d5cdd25 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:53.037160 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-820bfe5f-51e9-480a-b80c-613a9d5cdd25 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:53.203053 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-820bfe5f-51e9-480a-b80c-613a9d5cdd25 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:53.207129 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:42:53.213398 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-820bfe5f-51e9-480a-b80c-613a9d5cdd25 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:53.214941 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-820bfe5f-51e9-480a-b80c-613a9d5cdd25 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:53.216353 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-820bfe5f-51e9-480a-b80c-613a9d5cdd25 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1806 microversion: 2.20 time: 0.196528 Jul 12 17:42:53.216695 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 264/506] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:53 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1806 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:42:53.249431 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b59f2614-ec0a-4d22-a180-c87eacd1e80d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:53.250365 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-b59f2614-ec0a-4d22-a180-c87eacd1e80d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:53.257279 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b59f2614-ec0a-4d22-a180-c87eacd1e80d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:53.257801 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b59f2614-ec0a-4d22-a180-c87eacd1e80d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:53.258995 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b59f2614-ec0a-4d22-a180-c87eacd1e80d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:53.259551 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b59f2614-ec0a-4d22-a180-c87eacd1e80d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:53.328047 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-b59f2614-ec0a-4d22-a180-c87eacd1e80d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:53.337350 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-b59f2614-ec0a-4d22-a180-c87eacd1e80d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1317 microversion: 2.1 time: 0.092291 Jul 12 17:42:53.338114 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 243/507] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:53 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1317 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:42:53.511398 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-46d6737c-abb0-4eab-b116-32b37f85d370 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:53.512017 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-46d6737c-abb0-4eab-b116-32b37f85d370 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:53.518872 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-46d6737c-abb0-4eab-b116-32b37f85d370 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:53.519301 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-46d6737c-abb0-4eab-b116-32b37f85d370 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:53.520103 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-46d6737c-abb0-4eab-b116-32b37f85d370 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:53.520548 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-46d6737c-abb0-4eab-b116-32b37f85d370 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:53.659711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-46d6737c-abb0-4eab-b116-32b37f85d370 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:53.667288 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-46d6737c-abb0-4eab-b116-32b37f85d370 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1267 microversion: 2.1 time: 0.159865 Jul 12 17:42:53.667856 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 265/508] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:53 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:42:53.711092 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-295b3412-f525-41d9-bb20-dd0b0b8357a0 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:53.711899 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-295b3412-f525-41d9-bb20-dd0b0b8357a0 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:53.718026 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-295b3412-f525-41d9-bb20-dd0b0b8357a0 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:53.718559 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-295b3412-f525-41d9-bb20-dd0b0b8357a0 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:53.719338 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-295b3412-f525-41d9-bb20-dd0b0b8357a0 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:53.719826 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-295b3412-f525-41d9-bb20-dd0b0b8357a0 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:53.900098 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-295b3412-f525-41d9-bb20-dd0b0b8357a0 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:53.908505 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-295b3412-f525-41d9-bb20-dd0b0b8357a0 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1314 microversion: 2.1 time: 0.200867 Jul 12 17:42:53.917822 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 244/509] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:53 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:53.998574 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a36152b2-45a2-4988-927d-ceb968719003 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:53.999596 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-a36152b2-45a2-4988-927d-ceb968719003 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:54.006806 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a36152b2-45a2-4988-927d-ceb968719003 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:54.007375 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a36152b2-45a2-4988-927d-ceb968719003 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:54.008405 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a36152b2-45a2-4988-927d-ceb968719003 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:54.008947 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a36152b2-45a2-4988-927d-ceb968719003 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:54.043009 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-a36152b2-45a2-4988-927d-ceb968719003 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048718 Jul 12 17:42:54.043516 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 266/510] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:42:53 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:42:54.236194 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-aa5c561d-aedd-4817-a0a0-4313e1043364 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:54.236852 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-aa5c561d-aedd-4817-a0a0-4313e1043364 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:54.244722 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-aa5c561d-aedd-4817-a0a0-4313e1043364 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:54.245159 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-aa5c561d-aedd-4817-a0a0-4313e1043364 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:54.245958 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-aa5c561d-aedd-4817-a0a0-4313e1043364 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:54.246405 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-aa5c561d-aedd-4817-a0a0-4313e1043364 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:54.359053 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-bf3705d4-423e-4480-90ae-0089d92525d7 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:54.361404 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-bf3705d4-423e-4480-90ae-0089d92525d7 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:54.371413 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bf3705d4-423e-4480-90ae-0089d92525d7 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:54.372181 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bf3705d4-423e-4480-90ae-0089d92525d7 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:54.373121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bf3705d4-423e-4480-90ae-0089d92525d7 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:54.373828 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bf3705d4-423e-4480-90ae-0089d92525d7 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:54.420620 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-aa5c561d-aedd-4817-a0a0-4313e1043364 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:54.431315 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-aa5c561d-aedd-4817-a0a0-4313e1043364 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:54.434239 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-aa5c561d-aedd-4817-a0a0-4313e1043364 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:54.434239 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-aa5c561d-aedd-4817-a0a0-4313e1043364 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1806 microversion: 2.20 time: 0.202508 Jul 12 17:42:54.434784 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 245/511] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:54 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1806 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:42:54.443905 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-bf3705d4-423e-4480-90ae-0089d92525d7 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:54.452087 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-bf3705d4-423e-4480-90ae-0089d92525d7 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1317 microversion: 2.1 time: 0.100277 Jul 12 17:42:54.454282 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 267/512] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:54 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1317 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:54.686356 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-f6eeee7b-71af-40c3-bc2d-15c147413e4d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:54.687029 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-f6eeee7b-71af-40c3-bc2d-15c147413e4d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:54.694635 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f6eeee7b-71af-40c3-bc2d-15c147413e4d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:54.695405 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f6eeee7b-71af-40c3-bc2d-15c147413e4d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:54.695953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f6eeee7b-71af-40c3-bc2d-15c147413e4d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:54.696970 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f6eeee7b-71af-40c3-bc2d-15c147413e4d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:54.855260 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-f6eeee7b-71af-40c3-bc2d-15c147413e4d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:54.864387 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-f6eeee7b-71af-40c3-bc2d-15c147413e4d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1267 microversion: 2.1 time: 0.182394 Jul 12 17:42:54.865243 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 246/513] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:54 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:54.925170 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-b91db555-5507-46b0-bf80-af5481504455 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:54.925789 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-b91db555-5507-46b0-bf80-af5481504455 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:54.932388 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b91db555-5507-46b0-bf80-af5481504455 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:54.932872 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b91db555-5507-46b0-bf80-af5481504455 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:54.933652 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b91db555-5507-46b0-bf80-af5481504455 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:54.934091 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b91db555-5507-46b0-bf80-af5481504455 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:55.059100 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-0012a33a-74eb-40cb-ac83-913f366031f2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:55.060511 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-0012a33a-74eb-40cb-ac83-913f366031f2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:55.068845 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0012a33a-74eb-40cb-ac83-913f366031f2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:55.069407 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0012a33a-74eb-40cb-ac83-913f366031f2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:55.070290 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0012a33a-74eb-40cb-ac83-913f366031f2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:55.070754 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0012a33a-74eb-40cb-ac83-913f366031f2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:55.105233 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-0012a33a-74eb-40cb-ac83-913f366031f2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053288 Jul 12 17:42:55.105865 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 247/514] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:42:55 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:42:55.140276 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-b91db555-5507-46b0-bf80-af5481504455 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:55.151654 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-b91db555-5507-46b0-bf80-af5481504455 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1314 microversion: 2.1 time: 0.230779 Jul 12 17:42:55.152253 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 268/515] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:54 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:55.457372 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-0e117b4c-fae5-47c2-beb8-fca98a27c12d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:55.457998 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-0e117b4c-fae5-47c2-beb8-fca98a27c12d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:55.465158 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0e117b4c-fae5-47c2-beb8-fca98a27c12d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:55.465939 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0e117b4c-fae5-47c2-beb8-fca98a27c12d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:55.466924 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0e117b4c-fae5-47c2-beb8-fca98a27c12d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:55.467371 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0e117b4c-fae5-47c2-beb8-fca98a27c12d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:55.472105 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-6bdf4e42-aeab-49ae-a172-72dc70765865 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:55.472848 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-6bdf4e42-aeab-49ae-a172-72dc70765865 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:55.485770 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6bdf4e42-aeab-49ae-a172-72dc70765865 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:55.485770 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6bdf4e42-aeab-49ae-a172-72dc70765865 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:55.485770 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6bdf4e42-aeab-49ae-a172-72dc70765865 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:55.486285 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6bdf4e42-aeab-49ae-a172-72dc70765865 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:55.498500 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=100 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:42:55.640083 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-6bdf4e42-aeab-49ae-a172-72dc70765865 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:55.647110 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0e117b4c-fae5-47c2-beb8-fca98a27c12d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:55.656176 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-6bdf4e42-aeab-49ae-a172-72dc70765865 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1357 microversion: 2.1 time: 0.189030 Jul 12 17:42:55.657007 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0e117b4c-fae5-47c2-beb8-fca98a27c12d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:55.657889 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 269/516] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:55 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:55.659389 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0e117b4c-fae5-47c2-beb8-fca98a27c12d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:55.660492 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-0e117b4c-fae5-47c2-beb8-fca98a27c12d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1806 microversion: 2.20 time: 0.208881 Jul 12 17:42:55.661041 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 248/517] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:55 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1806 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:42:55.882307 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-80d160b3-ab70-491f-863b-5ed8aeefbd94 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:55.882986 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-80d160b3-ab70-491f-863b-5ed8aeefbd94 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:55.889568 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-80d160b3-ab70-491f-863b-5ed8aeefbd94 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:55.890011 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-80d160b3-ab70-491f-863b-5ed8aeefbd94 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:55.890877 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-80d160b3-ab70-491f-863b-5ed8aeefbd94 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:55.891587 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-80d160b3-ab70-491f-863b-5ed8aeefbd94 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:56.040562 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-80d160b3-ab70-491f-863b-5ed8aeefbd94 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:56.049094 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-80d160b3-ab70-491f-863b-5ed8aeefbd94 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1267 microversion: 2.1 time: 0.171049 Jul 12 17:42:56.049765 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 270/518] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:55 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:56.117686 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b4dbc99e-542a-460d-a7ea-9d6c0d1fbf1f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:56.118830 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-b4dbc99e-542a-460d-a7ea-9d6c0d1fbf1f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:56.125514 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b4dbc99e-542a-460d-a7ea-9d6c0d1fbf1f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:56.126219 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b4dbc99e-542a-460d-a7ea-9d6c0d1fbf1f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:56.127137 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b4dbc99e-542a-460d-a7ea-9d6c0d1fbf1f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:56.127570 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b4dbc99e-542a-460d-a7ea-9d6c0d1fbf1f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:56.158824 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-b4dbc99e-542a-460d-a7ea-9d6c0d1fbf1f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044927 Jul 12 17:42:56.159372 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 249/519] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:42:56 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:42:56.169325 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ef5f5188-c5a0-4ce8-8d01-59980502116b tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:56.169958 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-ef5f5188-c5a0-4ce8-8d01-59980502116b tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:56.176729 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ef5f5188-c5a0-4ce8-8d01-59980502116b tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:56.177183 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ef5f5188-c5a0-4ce8-8d01-59980502116b tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:56.177951 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ef5f5188-c5a0-4ce8-8d01-59980502116b tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:56.178389 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ef5f5188-c5a0-4ce8-8d01-59980502116b tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:56.315879 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-ef5f5188-c5a0-4ce8-8d01-59980502116b tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:56.323915 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-ef5f5188-c5a0-4ce8-8d01-59980502116b tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1314 microversion: 2.1 time: 0.158482 Jul 12 17:42:56.324495 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 271/520] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:56 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:56.673190 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-a7949b4e-83c4-4e70-b4a0-533ff83e53d5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:56.673802 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-a7949b4e-83c4-4e70-b4a0-533ff83e53d5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:56.678917 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-b7e36dee-1d9d-4319-8530-42c808745b41 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:56.679532 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-b7e36dee-1d9d-4319-8530-42c808745b41 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:56.680880 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a7949b4e-83c4-4e70-b4a0-533ff83e53d5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:56.681342 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a7949b4e-83c4-4e70-b4a0-533ff83e53d5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:56.682372 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a7949b4e-83c4-4e70-b4a0-533ff83e53d5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:56.682579 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a7949b4e-83c4-4e70-b4a0-533ff83e53d5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:56.685425 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b7e36dee-1d9d-4319-8530-42c808745b41 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:56.685883 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b7e36dee-1d9d-4319-8530-42c808745b41 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:56.686690 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b7e36dee-1d9d-4319-8530-42c808745b41 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:56.687130 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b7e36dee-1d9d-4319-8530-42c808745b41 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:56.819911 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-a7949b4e-83c4-4e70-b4a0-533ff83e53d5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:56.821438 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-b7e36dee-1d9d-4319-8530-42c808745b41 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:56.827545 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-a7949b4e-83c4-4e70-b4a0-533ff83e53d5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1357 microversion: 2.1 time: 0.158266 Jul 12 17:42:56.828148 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 250/521] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:56 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:56.829852 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-b7e36dee-1d9d-4319-8530-42c808745b41 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:56.831398 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-b7e36dee-1d9d-4319-8530-42c808745b41 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:56.833529 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-b7e36dee-1d9d-4319-8530-42c808745b41 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1806 microversion: 2.20 time: 0.158676 Jul 12 17:42:56.834073 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 272/522] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:56 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:42:57.071226 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-62b68741-74c5-494a-8ad1-abdc8cf42e5b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:57.071957 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-62b68741-74c5-494a-8ad1-abdc8cf42e5b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:57.083347 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-62b68741-74c5-494a-8ad1-abdc8cf42e5b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:57.085009 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-62b68741-74c5-494a-8ad1-abdc8cf42e5b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:57.087037 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-62b68741-74c5-494a-8ad1-abdc8cf42e5b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:57.087621 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-62b68741-74c5-494a-8ad1-abdc8cf42e5b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:57.184679 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-c591a5b5-9a41-4411-bc69-fe9cb3f51fd9 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:57.185936 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-c591a5b5-9a41-4411-bc69-fe9cb3f51fd9 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:57.205980 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c591a5b5-9a41-4411-bc69-fe9cb3f51fd9 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:57.206469 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c591a5b5-9a41-4411-bc69-fe9cb3f51fd9 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:57.208170 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c591a5b5-9a41-4411-bc69-fe9cb3f51fd9 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:57.208630 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c591a5b5-9a41-4411-bc69-fe9cb3f51fd9 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:57.248943 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-c591a5b5-9a41-4411-bc69-fe9cb3f51fd9 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080287 Jul 12 17:42:57.253162 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 273/523] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:42:57 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:42:57.322355 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-62b68741-74c5-494a-8ad1-abdc8cf42e5b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:57.349594 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-f6df9b71-ff8f-4309-bd2f-135dbca2cf19 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:57.349855 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-62b68741-74c5-494a-8ad1-abdc8cf42e5b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1267 microversion: 2.1 time: 0.286959 Jul 12 17:42:57.350227 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-f6df9b71-ff8f-4309-bd2f-135dbca2cf19 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:57.351967 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 251/524] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:57 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1267 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:57.357288 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=96 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:42:57.372114 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f6df9b71-ff8f-4309-bd2f-135dbca2cf19 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:57.373281 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f6df9b71-ff8f-4309-bd2f-135dbca2cf19 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:57.376479 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f6df9b71-ff8f-4309-bd2f-135dbca2cf19 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:57.376956 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f6df9b71-ff8f-4309-bd2f-135dbca2cf19 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:57.663038 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-f6df9b71-ff8f-4309-bd2f-135dbca2cf19 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:57.674705 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-f6df9b71-ff8f-4309-bd2f-135dbca2cf19 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1314 microversion: 2.1 time: 0.330417 Jul 12 17:42:57.679193 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 274/525] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:57 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:57.846375 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-e70be9ef-9b62-4fbd-a102-8d3f74b87e93 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:57.848193 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-e70be9ef-9b62-4fbd-a102-8d3f74b87e93 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:57.852097 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-afd56969-433d-4fe7-8587-b9793d5c5472 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:57.852578 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-afd56969-433d-4fe7-8587-b9793d5c5472 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:57.861658 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e70be9ef-9b62-4fbd-a102-8d3f74b87e93 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:57.862155 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e70be9ef-9b62-4fbd-a102-8d3f74b87e93 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:57.865088 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e70be9ef-9b62-4fbd-a102-8d3f74b87e93 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:57.870670 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-afd56969-433d-4fe7-8587-b9793d5c5472 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:57.870980 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e70be9ef-9b62-4fbd-a102-8d3f74b87e93 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:57.871085 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-afd56969-433d-4fe7-8587-b9793d5c5472 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:57.871085 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-afd56969-433d-4fe7-8587-b9793d5c5472 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:57.871085 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-afd56969-433d-4fe7-8587-b9793d5c5472 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:58.127384 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-e70be9ef-9b62-4fbd-a102-8d3f74b87e93 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:58.149489 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-e70be9ef-9b62-4fbd-a102-8d3f74b87e93 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1357 microversion: 2.1 time: 0.307950 Jul 12 17:42:58.150101 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 252/526] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:57 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1357 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:58.181236 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-8797ae85-bada-4fb6-ac46-33dc423608b8 req-58dc8866-05be-4769-8296-43389d6ddecf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d57de92-32ca-4ff9-a5ea-00d7e83bbf72", "tag": "c4901ed1-f277-462c-b8b5-c19838c33e73"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:42:58.198130 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-8797ae85-bada-4fb6-ac46-33dc423608b8 req-58dc8866-05be-4769-8296-43389d6ddecf service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:58.199339 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-8797ae85-bada-4fb6-ac46-33dc423608b8 req-58dc8866-05be-4769-8296-43389d6ddecf service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:58.214558 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-8797ae85-bada-4fb6-ac46-33dc423608b8 req-58dc8866-05be-4769-8296-43389d6ddecf service nova] Creating event network-changed:c4901ed1-f277-462c-b8b5-c19838c33e73 for instance 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 on hv-cinder-84875 Jul 12 17:42:58.225754 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-8797ae85-bada-4fb6-ac46-33dc423608b8 req-58dc8866-05be-4769-8296-43389d6ddecf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055275 Jul 12 17:42:58.226658 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-afd56969-433d-4fe7-8587-b9793d5c5472 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:58.227522 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 253/527] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:42:58.238087 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-afd56969-433d-4fe7-8587-b9793d5c5472 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:58.254629 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-afd56969-433d-4fe7-8587-b9793d5c5472 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:58.264556 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-becd8e3e-1fc8-4bc8-83e7-008f5f6b6a87 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:58.265529 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-afd56969-433d-4fe7-8587-b9793d5c5472 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1806 microversion: 2.20 time: 0.416949 Jul 12 17:42:58.266032 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-becd8e3e-1fc8-4bc8-83e7-008f5f6b6a87 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:58.267126 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 275/528] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:57 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1806 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:42:58.287000 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-becd8e3e-1fc8-4bc8-83e7-008f5f6b6a87 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:58.287747 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-becd8e3e-1fc8-4bc8-83e7-008f5f6b6a87 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:58.289264 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-becd8e3e-1fc8-4bc8-83e7-008f5f6b6a87 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:58.290395 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-becd8e3e-1fc8-4bc8-83e7-008f5f6b6a87 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:58.354680 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-becd8e3e-1fc8-4bc8-83e7-008f5f6b6a87 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095853 Jul 12 17:42:58.362805 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 254/529] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:42:58 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:42:58.368944 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-7ee0737c-5cf1-4a9e-b9d5-5108eb46d656 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:58.369455 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-7ee0737c-5cf1-4a9e-b9d5-5108eb46d656 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:58.382724 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7ee0737c-5cf1-4a9e-b9d5-5108eb46d656 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:58.386952 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7ee0737c-5cf1-4a9e-b9d5-5108eb46d656 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:58.388380 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7ee0737c-5cf1-4a9e-b9d5-5108eb46d656 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:58.389162 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7ee0737c-5cf1-4a9e-b9d5-5108eb46d656 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:58.697472 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-1f684cab-0191-431c-abd3-8b21eae863dc tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:58.698343 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-1f684cab-0191-431c-abd3-8b21eae863dc tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:58.713308 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1f684cab-0191-431c-abd3-8b21eae863dc tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:58.714005 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1f684cab-0191-431c-abd3-8b21eae863dc tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:58.714959 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1f684cab-0191-431c-abd3-8b21eae863dc tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:58.718983 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1f684cab-0191-431c-abd3-8b21eae863dc tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:59.032828 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-7ee0737c-5cf1-4a9e-b9d5-5108eb46d656 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:59.042209 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-7ee0737c-5cf1-4a9e-b9d5-5108eb46d656 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1454 microversion: 2.1 time: 0.676853 Jul 12 17:42:59.043579 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-1f684cab-0191-431c-abd3-8b21eae863dc tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:59.055310 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-1f684cab-0191-431c-abd3-8b21eae863dc tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1314 microversion: 2.1 time: 0.363437 Jul 12 17:42:59.056165 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 255/530] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:58 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:42:59.060099 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 276/531] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:58 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1454 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:42:59.072697 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-67b94baa-7779-4aff-a56e-b345200c562a tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:59.074234 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-67b94baa-7779-4aff-a56e-b345200c562a tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:59.083148 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-67b94baa-7779-4aff-a56e-b345200c562a tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:59.084088 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-67b94baa-7779-4aff-a56e-b345200c562a tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:59.085048 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-67b94baa-7779-4aff-a56e-b345200c562a tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:59.085638 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-67b94baa-7779-4aff-a56e-b345200c562a tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:59.166763 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-dfc2b828-5e73-4aba-8c07-98162692be23 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:59.167421 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-dfc2b828-5e73-4aba-8c07-98162692be23 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:59.175672 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-dfc2b828-5e73-4aba-8c07-98162692be23 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:59.176379 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-dfc2b828-5e73-4aba-8c07-98162692be23 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:59.178001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-dfc2b828-5e73-4aba-8c07-98162692be23 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:59.179078 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-dfc2b828-5e73-4aba-8c07-98162692be23 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:59.319063 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-67b94baa-7779-4aff-a56e-b345200c562a tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:59.328297 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-67b94baa-7779-4aff-a56e-b345200c562a tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1454 microversion: 2.1 time: 0.263519 Jul 12 17:42:59.330792 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 256/532] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:59 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1454 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:59.341613 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-8e8a2643-9713-4cdc-a821-4b021e67b41d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:59.342237 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-8e8a2643-9713-4cdc-a821-4b021e67b41d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:59.357729 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8e8a2643-9713-4cdc-a821-4b021e67b41d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:59.360585 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8e8a2643-9713-4cdc-a821-4b021e67b41d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:59.372439 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8e8a2643-9713-4cdc-a821-4b021e67b41d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:59.372439 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8e8a2643-9713-4cdc-a821-4b021e67b41d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:59.414325 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-dfc2b828-5e73-4aba-8c07-98162692be23 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:59.431134 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-dfc2b828-5e73-4aba-8c07-98162692be23 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1357 microversion: 2.1 time: 0.267791 Jul 12 17:42:59.450977 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 277/533] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:59 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1357 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:42:59.463470 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-b18d8fd7-b315-4175-97fd-f86ae5c29835 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:59.465893 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-b18d8fd7-b315-4175-97fd-f86ae5c29835 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:59.472465 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b18d8fd7-b315-4175-97fd-f86ae5c29835 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:59.473472 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b18d8fd7-b315-4175-97fd-f86ae5c29835 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:59.474516 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b18d8fd7-b315-4175-97fd-f86ae5c29835 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:59.474970 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b18d8fd7-b315-4175-97fd-f86ae5c29835 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:59.512508 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-b18d8fd7-b315-4175-97fd-f86ae5c29835 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059142 Jul 12 17:42:59.514239 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 278/534] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:42:59 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:42:59.650011 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-8e8a2643-9713-4cdc-a821-4b021e67b41d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:59.662065 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-8e8a2643-9713-4cdc-a821-4b021e67b41d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:59.663766 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-8e8a2643-9713-4cdc-a821-4b021e67b41d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:59.664998 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-8e8a2643-9713-4cdc-a821-4b021e67b41d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1806 microversion: 2.20 time: 0.328899 Jul 12 17:42:59.665981 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 257/535] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:42:59 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1806 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:43:00.072994 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-afddc8a4-f6b7-404a-86b2-68b6bfde5976 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:00.073575 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-afddc8a4-f6b7-404a-86b2-68b6bfde5976 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:00.087730 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-afddc8a4-f6b7-404a-86b2-68b6bfde5976 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:00.087730 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-afddc8a4-f6b7-404a-86b2-68b6bfde5976 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:00.088532 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-afddc8a4-f6b7-404a-86b2-68b6bfde5976 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:00.088985 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-afddc8a4-f6b7-404a-86b2-68b6bfde5976 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:00.150673 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-12636a53-151c-4e16-8a15-364e8f1d4108 req-7aaa9476-c015-484a-bebf-6c11dc3d1be5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e97f8453-690a-4d27-8061-81007783d32a", "name": "network-vif-plugged", "status": "completed", "tag": "6a7159ad-dc9e-4e19-93f7-f60cb2d94a73"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:43:00.164859 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-12636a53-151c-4e16-8a15-364e8f1d4108 req-7aaa9476-c015-484a-bebf-6c11dc3d1be5 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:00.165449 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-12636a53-151c-4e16-8a15-364e8f1d4108 req-7aaa9476-c015-484a-bebf-6c11dc3d1be5 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:00.180280 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-12636a53-151c-4e16-8a15-364e8f1d4108 req-7aaa9476-c015-484a-bebf-6c11dc3d1be5 service nova] Creating event network-vif-plugged:6a7159ad-dc9e-4e19-93f7-f60cb2d94a73 for instance e97f8453-690a-4d27-8061-81007783d32a on hv-cinder-84875 Jul 12 17:43:00.186021 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-12636a53-151c-4e16-8a15-364e8f1d4108 req-7aaa9476-c015-484a-bebf-6c11dc3d1be5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042922 Jul 12 17:43:00.194119 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 258/536] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:43:00.349524 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-afddc8a4-f6b7-404a-86b2-68b6bfde5976 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:00.360979 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-afddc8a4-f6b7-404a-86b2-68b6bfde5976 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1314 microversion: 2.1 time: 0.291846 Jul 12 17:43:00.372741 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 279/537] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:00 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:00.465808 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-0af26dee-4a61-4d5e-992f-7d4408d9866f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:00.466598 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-0af26dee-4a61-4d5e-992f-7d4408d9866f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:00.473952 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0af26dee-4a61-4d5e-992f-7d4408d9866f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:00.474516 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0af26dee-4a61-4d5e-992f-7d4408d9866f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:00.475620 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0af26dee-4a61-4d5e-992f-7d4408d9866f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:00.476078 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0af26dee-4a61-4d5e-992f-7d4408d9866f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:00.532659 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-9e7230fc-aa82-439d-988f-d0d0682d0ac1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:00.534533 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-9e7230fc-aa82-439d-988f-d0d0682d0ac1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:00.553063 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9e7230fc-aa82-439d-988f-d0d0682d0ac1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:00.553964 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9e7230fc-aa82-439d-988f-d0d0682d0ac1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:00.559907 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9e7230fc-aa82-439d-988f-d0d0682d0ac1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:00.560791 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9e7230fc-aa82-439d-988f-d0d0682d0ac1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:00.655297 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-9e7230fc-aa82-439d-988f-d0d0682d0ac1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127009 Jul 12 17:43:00.660436 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 280/538] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:43:00 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:43:00.686036 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ed9f9875-6f14-4202-ab8b-f3b47149b514 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:00.686925 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-ed9f9875-6f14-4202-ab8b-f3b47149b514 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:00.694738 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ed9f9875-6f14-4202-ab8b-f3b47149b514 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:00.695193 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ed9f9875-6f14-4202-ab8b-f3b47149b514 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:00.696207 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ed9f9875-6f14-4202-ab8b-f3b47149b514 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:00.696657 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ed9f9875-6f14-4202-ab8b-f3b47149b514 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:00.721627 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0af26dee-4a61-4d5e-992f-7d4408d9866f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:00.727490 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=100 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:43:00.730927 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-0af26dee-4a61-4d5e-992f-7d4408d9866f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1357 microversion: 2.1 time: 0.270549 Jul 12 17:43:00.731856 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 259/539] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:00 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1357 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:00.940772 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-ed9f9875-6f14-4202-ab8b-f3b47149b514 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:00.950187 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-ed9f9875-6f14-4202-ab8b-f3b47149b514 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:00.951801 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-ed9f9875-6f14-4202-ab8b-f3b47149b514 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:00.953150 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-ed9f9875-6f14-4202-ab8b-f3b47149b514 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1806 microversion: 2.20 time: 0.272412 Jul 12 17:43:00.953874 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 281/540] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:43:00 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1806 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:43:01.381168 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-f3f42125-be75-4a89-b5e1-d7ca6afa2c04 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:01.415601 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-f3f42125-be75-4a89-b5e1-d7ca6afa2c04 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:01.415601 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f3f42125-be75-4a89-b5e1-d7ca6afa2c04 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:01.415601 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f3f42125-be75-4a89-b5e1-d7ca6afa2c04 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:01.415601 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f3f42125-be75-4a89-b5e1-d7ca6afa2c04 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:01.416022 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f3f42125-be75-4a89-b5e1-d7ca6afa2c04 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:01.584075 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-f3f42125-be75-4a89-b5e1-d7ca6afa2c04 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:01.595369 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-f3f42125-be75-4a89-b5e1-d7ca6afa2c04 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1314 microversion: 2.1 time: 0.218516 Jul 12 17:43:01.596062 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 260/541] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:01 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:01.666966 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-5c349749-0cb5-4390-b12f-24d102776252 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:01.667980 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-5c349749-0cb5-4390-b12f-24d102776252 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:01.674789 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5c349749-0cb5-4390-b12f-24d102776252 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:01.675323 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5c349749-0cb5-4390-b12f-24d102776252 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:01.677009 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5c349749-0cb5-4390-b12f-24d102776252 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:01.677337 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5c349749-0cb5-4390-b12f-24d102776252 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:01.712368 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-5c349749-0cb5-4390-b12f-24d102776252 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049430 Jul 12 17:43:01.713146 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 282/542] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:43:01 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:43:01.749142 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-04aaa7fc-797e-4687-aa79-0dc6aa09b097 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:01.749754 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-04aaa7fc-797e-4687-aa79-0dc6aa09b097 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:01.764571 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-04aaa7fc-797e-4687-aa79-0dc6aa09b097 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:01.764571 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-04aaa7fc-797e-4687-aa79-0dc6aa09b097 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:01.764964 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-04aaa7fc-797e-4687-aa79-0dc6aa09b097 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:01.765405 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-04aaa7fc-797e-4687-aa79-0dc6aa09b097 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:01.909191 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-04aaa7fc-797e-4687-aa79-0dc6aa09b097 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:01.918352 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-04aaa7fc-797e-4687-aa79-0dc6aa09b097 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1357 microversion: 2.1 time: 0.173064 Jul 12 17:43:01.919124 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 261/543] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:01 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:01.972270 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-85684bc6-2a1e-4571-a3f3-f06d44eb7fca tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:01.973479 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-85684bc6-2a1e-4571-a3f3-f06d44eb7fca tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:01.980436 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-85684bc6-2a1e-4571-a3f3-f06d44eb7fca tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:01.980896 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-85684bc6-2a1e-4571-a3f3-f06d44eb7fca tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:01.981704 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-85684bc6-2a1e-4571-a3f3-f06d44eb7fca tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:01.982158 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-85684bc6-2a1e-4571-a3f3-f06d44eb7fca tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:02.229036 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-85684bc6-2a1e-4571-a3f3-f06d44eb7fca tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:02.240525 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-85684bc6-2a1e-4571-a3f3-f06d44eb7fca tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:02.244302 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-85684bc6-2a1e-4571-a3f3-f06d44eb7fca tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:02.244302 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-85684bc6-2a1e-4571-a3f3-f06d44eb7fca tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1806 microversion: 2.20 time: 0.275063 Jul 12 17:43:02.244302 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 283/544] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:43:01 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1806 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:43:02.617190 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-652755cf-91fd-4092-94e7-727c869e7c74 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:02.618600 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-652755cf-91fd-4092-94e7-727c869e7c74 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:02.634947 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-652755cf-91fd-4092-94e7-727c869e7c74 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:02.634947 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-652755cf-91fd-4092-94e7-727c869e7c74 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:02.635733 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-652755cf-91fd-4092-94e7-727c869e7c74 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:02.636103 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-652755cf-91fd-4092-94e7-727c869e7c74 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:02.724880 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-96dc5bd5-47cc-45df-984d-86573cdf0208 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:02.725819 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-96dc5bd5-47cc-45df-984d-86573cdf0208 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:02.732738 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-96dc5bd5-47cc-45df-984d-86573cdf0208 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:02.733198 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-96dc5bd5-47cc-45df-984d-86573cdf0208 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:02.733984 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-96dc5bd5-47cc-45df-984d-86573cdf0208 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:02.734419 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-96dc5bd5-47cc-45df-984d-86573cdf0208 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:02.831368 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-96dc5bd5-47cc-45df-984d-86573cdf0208 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110741 Jul 12 17:43:02.838601 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 284/545] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:43:02 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:43:02.840302 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-652755cf-91fd-4092-94e7-727c869e7c74 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:02.849787 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-652755cf-91fd-4092-94e7-727c869e7c74 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1314 microversion: 2.1 time: 0.237581 Jul 12 17:43:02.850513 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 262/546] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:02 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:02.874233 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-8e6b4c74-a737-4bf2-97a9-facb96ec1754 req-a0175594-5dad-424e-a116-a09457499902 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73d03675-d5c4-4778-a9c2-320d010588b7", "tag": "9dd6e257-1f75-4cdb-b508-53b460481a96"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:43:02.885435 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-8e6b4c74-a737-4bf2-97a9-facb96ec1754 req-a0175594-5dad-424e-a116-a09457499902 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:02.888581 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-8e6b4c74-a737-4bf2-97a9-facb96ec1754 req-a0175594-5dad-424e-a116-a09457499902 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:02.903737 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-8e6b4c74-a737-4bf2-97a9-facb96ec1754 req-a0175594-5dad-424e-a116-a09457499902 service nova] Creating event network-changed:9dd6e257-1f75-4cdb-b508-53b460481a96 for instance 73d03675-d5c4-4778-a9c2-320d010588b7 on hv-cinder-84875 Jul 12 17:43:02.910868 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-8e6b4c74-a737-4bf2-97a9-facb96ec1754 req-a0175594-5dad-424e-a116-a09457499902 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040325 Jul 12 17:43:02.911822 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 285/547] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:43:02.936664 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-93fa2c81-34a9-4304-86ac-b56885372e3b tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:02.937367 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-93fa2c81-34a9-4304-86ac-b56885372e3b tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:02.944552 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-93fa2c81-34a9-4304-86ac-b56885372e3b tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:02.945079 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-93fa2c81-34a9-4304-86ac-b56885372e3b tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:02.946070 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-93fa2c81-34a9-4304-86ac-b56885372e3b tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:02.946682 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-93fa2c81-34a9-4304-86ac-b56885372e3b tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:03.114159 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-93fa2c81-34a9-4304-86ac-b56885372e3b tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:03.121843 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-93fa2c81-34a9-4304-86ac-b56885372e3b tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1357 microversion: 2.1 time: 0.187111 Jul 12 17:43:03.132856 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 263/548] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:02 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1357 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:03.263467 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a72f6a88-9a8d-439c-82f0-78884ca5ddba tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:03.264344 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-a72f6a88-9a8d-439c-82f0-78884ca5ddba tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:03.274078 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a72f6a88-9a8d-439c-82f0-78884ca5ddba tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:03.274989 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a72f6a88-9a8d-439c-82f0-78884ca5ddba tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:03.276881 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a72f6a88-9a8d-439c-82f0-78884ca5ddba tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:03.277611 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a72f6a88-9a8d-439c-82f0-78884ca5ddba tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:03.507642 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a72f6a88-9a8d-439c-82f0-78884ca5ddba tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:03.517237 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a72f6a88-9a8d-439c-82f0-78884ca5ddba tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:03.518895 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a72f6a88-9a8d-439c-82f0-78884ca5ddba tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:03.520337 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-a72f6a88-9a8d-439c-82f0-78884ca5ddba tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1806 microversion: 2.20 time: 0.261946 Jul 12 17:43:03.531297 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 286/549] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:43:03 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1806 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:43:03.845454 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-322f723c-2625-42ae-a981-94dd9cc3bf45 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:03.846478 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-322f723c-2625-42ae-a981-94dd9cc3bf45 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:03.865829 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-64ae9f57-4a3a-48e7-b033-1d05fe9598ec tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:03.867344 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-64ae9f57-4a3a-48e7-b033-1d05fe9598ec tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:03.872355 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-322f723c-2625-42ae-a981-94dd9cc3bf45 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:03.874675 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-322f723c-2625-42ae-a981-94dd9cc3bf45 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:03.875775 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-322f723c-2625-42ae-a981-94dd9cc3bf45 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:03.876317 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-322f723c-2625-42ae-a981-94dd9cc3bf45 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:03.881197 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-64ae9f57-4a3a-48e7-b033-1d05fe9598ec tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:03.882027 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-64ae9f57-4a3a-48e7-b033-1d05fe9598ec tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:03.887865 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-64ae9f57-4a3a-48e7-b033-1d05fe9598ec tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:03.888714 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-64ae9f57-4a3a-48e7-b033-1d05fe9598ec tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:03.977016 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-322f723c-2625-42ae-a981-94dd9cc3bf45 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135660 Jul 12 17:43:03.988851 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 264/550] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:43:03 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:43:04.103774 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-64ae9f57-4a3a-48e7-b033-1d05fe9598ec tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:04.120585 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-64ae9f57-4a3a-48e7-b033-1d05fe9598ec tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1314 microversion: 2.1 time: 0.257680 Jul 12 17:43:04.122377 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 287/551] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:03 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:43:04.140613 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-90315f2b-33c3-4ff5-ae1a-63264ffaec43 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:04.141965 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-90315f2b-33c3-4ff5-ae1a-63264ffaec43 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:04.151249 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-90315f2b-33c3-4ff5-ae1a-63264ffaec43 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:04.153396 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-90315f2b-33c3-4ff5-ae1a-63264ffaec43 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:04.154465 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-90315f2b-33c3-4ff5-ae1a-63264ffaec43 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:04.155106 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-90315f2b-33c3-4ff5-ae1a-63264ffaec43 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:04.309060 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-0853690b-1fae-45fd-9db1-dbfb4f26bfad tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14fbcf4d-bab4-4646-a6b3-c9277be07fd8"}} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:43:04.310644 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-0853690b-1fae-45fd-9db1-dbfb4f26bfad tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:04.318442 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0853690b-1fae-45fd-9db1-dbfb4f26bfad tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:04.319324 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0853690b-1fae-45fd-9db1-dbfb4f26bfad tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:04.320844 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0853690b-1fae-45fd-9db1-dbfb4f26bfad tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:04.321361 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0853690b-1fae-45fd-9db1-dbfb4f26bfad tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:04.356469 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-90315f2b-33c3-4ff5-ae1a-63264ffaec43 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:04.366548 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-90315f2b-33c3-4ff5-ae1a-63264ffaec43 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1357 microversion: 2.1 time: 0.229749 Jul 12 17:43:04.367329 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 265/552] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:04 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1357 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:43:04.539444 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-5bf44794-ff60-453e-8161-512132a5b862 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:04.540058 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-5bf44794-ff60-453e-8161-512132a5b862 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:04.554789 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5bf44794-ff60-453e-8161-512132a5b862 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:04.555300 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5bf44794-ff60-453e-8161-512132a5b862 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:04.556497 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5bf44794-ff60-453e-8161-512132a5b862 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:04.557133 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5bf44794-ff60-453e-8161-512132a5b862 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:04.590423 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=100 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:43:04.736475 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-5bf44794-ff60-453e-8161-512132a5b862 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:04.749009 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-5bf44794-ff60-453e-8161-512132a5b862 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:04.750584 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-5bf44794-ff60-453e-8161-512132a5b862 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:04.751966 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-5bf44794-ff60-453e-8161-512132a5b862 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1806 microversion: 2.20 time: 0.217498 Jul 12 17:43:04.752581 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 266/553] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:43:04 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1806 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:43:04.990295 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-588f5561-243e-4980-834d-57cbeb7c7f08 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:04.991702 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-588f5561-243e-4980-834d-57cbeb7c7f08 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:04.999189 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-588f5561-243e-4980-834d-57cbeb7c7f08 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:04.999726 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-588f5561-243e-4980-834d-57cbeb7c7f08 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:05.000628 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-588f5561-243e-4980-834d-57cbeb7c7f08 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:05.001684 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-588f5561-243e-4980-834d-57cbeb7c7f08 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:05.034748 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-588f5561-243e-4980-834d-57cbeb7c7f08 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048819 Jul 12 17:43:05.100811 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 267/554] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:43:04 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:43:05.138941 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-cd3a66f6-0e7d-451a-9c5d-a8cc55254416 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:05.139890 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-cd3a66f6-0e7d-451a-9c5d-a8cc55254416 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:05.147673 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cd3a66f6-0e7d-451a-9c5d-a8cc55254416 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:05.148420 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cd3a66f6-0e7d-451a-9c5d-a8cc55254416 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:05.149421 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cd3a66f6-0e7d-451a-9c5d-a8cc55254416 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:05.150037 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cd3a66f6-0e7d-451a-9c5d-a8cc55254416 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:05.333035 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-cd3a66f6-0e7d-451a-9c5d-a8cc55254416 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:05.343380 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-cd3a66f6-0e7d-451a-9c5d-a8cc55254416 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1314 microversion: 2.1 time: 0.208530 Jul 12 17:43:05.356235 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 268/555] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:05 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:43:05.385131 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b9a53b25-0d6c-4b88-9391-b564d6abd0ee tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:05.386051 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-b9a53b25-0d6c-4b88-9391-b564d6abd0ee tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:05.392388 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b9a53b25-0d6c-4b88-9391-b564d6abd0ee tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:05.392835 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b9a53b25-0d6c-4b88-9391-b564d6abd0ee tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:05.393718 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b9a53b25-0d6c-4b88-9391-b564d6abd0ee tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:05.394150 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b9a53b25-0d6c-4b88-9391-b564d6abd0ee tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:05.562648 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-b9a53b25-0d6c-4b88-9391-b564d6abd0ee tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:05.572040 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-b9a53b25-0d6c-4b88-9391-b564d6abd0ee tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1357 microversion: 2.1 time: 0.191238 Jul 12 17:43:05.572839 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 269/556] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:05 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1357 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:43:05.772314 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-532c8edb-9d47-4556-9724-6d42cfce2fed tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:05.772610 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-532c8edb-9d47-4556-9724-6d42cfce2fed tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:05.779133 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-532c8edb-9d47-4556-9724-6d42cfce2fed tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:05.788108 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-532c8edb-9d47-4556-9724-6d42cfce2fed tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:05.788108 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-532c8edb-9d47-4556-9724-6d42cfce2fed tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:05.788108 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-532c8edb-9d47-4556-9724-6d42cfce2fed tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:05.948741 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-532c8edb-9d47-4556-9724-6d42cfce2fed tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:05.959801 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-532c8edb-9d47-4556-9724-6d42cfce2fed tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:05.961489 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-532c8edb-9d47-4556-9724-6d42cfce2fed tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:05.962705 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-532c8edb-9d47-4556-9724-6d42cfce2fed tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1806 microversion: 2.20 time: 0.195319 Jul 12 17:43:05.963651 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 270/557] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:43:05 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1806 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:43:06.111162 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-9391eeb7-f490-4253-8bbf-7af82974c2e8 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:06.112271 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-9391eeb7-f490-4253-8bbf-7af82974c2e8 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:06.120002 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9391eeb7-f490-4253-8bbf-7af82974c2e8 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:06.120548 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9391eeb7-f490-4253-8bbf-7af82974c2e8 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:06.121388 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9391eeb7-f490-4253-8bbf-7af82974c2e8 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:06.121903 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9391eeb7-f490-4253-8bbf-7af82974c2e8 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:06.157733 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-9391eeb7-f490-4253-8bbf-7af82974c2e8 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050513 Jul 12 17:43:06.158465 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 271/558] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:43:06 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:43:06.364618 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-151fac28-8abb-4f18-b4ee-b06c0503d8fe tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:06.365460 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-151fac28-8abb-4f18-b4ee-b06c0503d8fe tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:06.372364 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-151fac28-8abb-4f18-b4ee-b06c0503d8fe tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:06.372964 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-151fac28-8abb-4f18-b4ee-b06c0503d8fe tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:06.373783 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-151fac28-8abb-4f18-b4ee-b06c0503d8fe tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:06.374303 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-151fac28-8abb-4f18-b4ee-b06c0503d8fe tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:06.516182 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-151fac28-8abb-4f18-b4ee-b06c0503d8fe tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:06.525262 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-151fac28-8abb-4f18-b4ee-b06c0503d8fe tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1314 microversion: 2.1 time: 0.165405 Jul 12 17:43:06.525856 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 272/559] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:06 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:43:06.593426 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-0c04cabe-4efe-4ba0-8611-69b650308712 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:06.593974 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-0c04cabe-4efe-4ba0-8611-69b650308712 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:06.600812 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0c04cabe-4efe-4ba0-8611-69b650308712 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:06.602120 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0c04cabe-4efe-4ba0-8611-69b650308712 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:06.602250 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0c04cabe-4efe-4ba0-8611-69b650308712 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:06.603370 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0c04cabe-4efe-4ba0-8611-69b650308712 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:06.736349 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0c04cabe-4efe-4ba0-8611-69b650308712 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:06.745032 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-0c04cabe-4efe-4ba0-8611-69b650308712 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1357 microversion: 2.1 time: 0.155592 Jul 12 17:43:06.745615 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 273/560] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:06 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:43:06.981672 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-081bcf14-6535-4def-b009-ce513e8241b8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:06.982315 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-081bcf14-6535-4def-b009-ce513e8241b8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:06.988914 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-081bcf14-6535-4def-b009-ce513e8241b8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:06.989366 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-081bcf14-6535-4def-b009-ce513e8241b8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:06.990137 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-081bcf14-6535-4def-b009-ce513e8241b8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:06.990607 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-081bcf14-6535-4def-b009-ce513e8241b8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:07.140051 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-081bcf14-6535-4def-b009-ce513e8241b8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:07.149857 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-081bcf14-6535-4def-b009-ce513e8241b8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:07.151449 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-081bcf14-6535-4def-b009-ce513e8241b8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:07.152691 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-081bcf14-6535-4def-b009-ce513e8241b8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1806 microversion: 2.20 time: 0.174977 Jul 12 17:43:07.153309 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 274/561] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:43:06 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:43:07.169884 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-ff8f8b9d-8855-4798-a7f5-4e15070a97c6 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:07.171040 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-ff8f8b9d-8855-4798-a7f5-4e15070a97c6 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:07.177479 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ff8f8b9d-8855-4798-a7f5-4e15070a97c6 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:07.177940 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ff8f8b9d-8855-4798-a7f5-4e15070a97c6 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:07.178763 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ff8f8b9d-8855-4798-a7f5-4e15070a97c6 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:07.179210 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ff8f8b9d-8855-4798-a7f5-4e15070a97c6 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:07.220201 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-ff8f8b9d-8855-4798-a7f5-4e15070a97c6 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054285 Jul 12 17:43:07.220876 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 275/562] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:43:07 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:43:07.541891 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-3d124ede-7147-40c6-b60c-3d4632569a2e tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:07.542420 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-3d124ede-7147-40c6-b60c-3d4632569a2e tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:07.548927 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3d124ede-7147-40c6-b60c-3d4632569a2e tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:07.549376 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3d124ede-7147-40c6-b60c-3d4632569a2e tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:07.550141 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3d124ede-7147-40c6-b60c-3d4632569a2e tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:07.550640 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3d124ede-7147-40c6-b60c-3d4632569a2e tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:07.703726 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-3d124ede-7147-40c6-b60c-3d4632569a2e tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:07.712418 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-3d124ede-7147-40c6-b60c-3d4632569a2e tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1314 microversion: 2.1 time: 0.174424 Jul 12 17:43:07.713063 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 276/563] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:07 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:43:07.761884 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-bdbaa068-30c5-4b5e-b461-1e6111f571c5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:07.762551 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-bdbaa068-30c5-4b5e-b461-1e6111f571c5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:07.769051 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bdbaa068-30c5-4b5e-b461-1e6111f571c5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:07.769691 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bdbaa068-30c5-4b5e-b461-1e6111f571c5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:07.770801 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bdbaa068-30c5-4b5e-b461-1e6111f571c5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:07.771235 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bdbaa068-30c5-4b5e-b461-1e6111f571c5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:07.923442 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-bdbaa068-30c5-4b5e-b461-1e6111f571c5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:07.932750 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-bdbaa068-30c5-4b5e-b461-1e6111f571c5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1357 microversion: 2.1 time: 0.174845 Jul 12 17:43:07.934764 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 277/564] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:07 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:43:08.172369 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-201465a9-21f3-4b10-8ca3-5db1aaad6dce tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:08.173017 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-201465a9-21f3-4b10-8ca3-5db1aaad6dce tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:08.182072 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-201465a9-21f3-4b10-8ca3-5db1aaad6dce tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:08.182549 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-201465a9-21f3-4b10-8ca3-5db1aaad6dce tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:08.183336 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-201465a9-21f3-4b10-8ca3-5db1aaad6dce tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:08.183764 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-201465a9-21f3-4b10-8ca3-5db1aaad6dce tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:08.324694 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-201465a9-21f3-4b10-8ca3-5db1aaad6dce tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:08.334575 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-201465a9-21f3-4b10-8ca3-5db1aaad6dce tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:08.336169 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-201465a9-21f3-4b10-8ca3-5db1aaad6dce tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:08.337370 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-201465a9-21f3-4b10-8ca3-5db1aaad6dce tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1806 microversion: 2.20 time: 0.169032 Jul 12 17:43:08.337962 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 278/565] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:43:08 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:43:08.342775 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b1944d41-9acf-4304-a885-ddcbbd16f19c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:08.343880 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-b1944d41-9acf-4304-a885-ddcbbd16f19c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:08.351543 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b1944d41-9acf-4304-a885-ddcbbd16f19c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:08.352049 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b1944d41-9acf-4304-a885-ddcbbd16f19c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:08.353027 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b1944d41-9acf-4304-a885-ddcbbd16f19c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:08.353474 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b1944d41-9acf-4304-a885-ddcbbd16f19c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:08.387580 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-b1944d41-9acf-4304-a885-ddcbbd16f19c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048158 Jul 12 17:43:08.387990 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 279/566] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:43:08 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:43:08.730013 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-5d07887d-00a8-4480-b337-6ad455116208 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:08.733406 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-5d07887d-00a8-4480-b337-6ad455116208 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:08.743117 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5d07887d-00a8-4480-b337-6ad455116208 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:08.743562 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5d07887d-00a8-4480-b337-6ad455116208 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:08.744631 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5d07887d-00a8-4480-b337-6ad455116208 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:08.745233 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5d07887d-00a8-4480-b337-6ad455116208 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:09.344923 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-0853690b-1fae-45fd-9db1-dbfb4f26bfad tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "POST /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.043247 Jul 12 17:43:09.346500 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 288/567] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jul 12 17:43:04 2022] POST /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b/os-volume_attachments => generated 194 bytes in 5045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:43:09.367419 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-019994a8-cad8-4e12-ab36-51ade0f8923a tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:09.371654 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-019994a8-cad8-4e12-ab36-51ade0f8923a tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:09.386853 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-019994a8-cad8-4e12-ab36-51ade0f8923a tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:09.387780 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-019994a8-cad8-4e12-ab36-51ade0f8923a tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:09.393493 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-019994a8-cad8-4e12-ab36-51ade0f8923a tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:09.395708 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-019994a8-cad8-4e12-ab36-51ade0f8923a tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:09.451207 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-5d07887d-00a8-4480-b337-6ad455116208 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:09.460513 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-5d07887d-00a8-4480-b337-6ad455116208 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1314 microversion: 2.1 time: 0.734542 Jul 12 17:43:09.461418 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 280/568] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:08 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1314 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:43:09.466380 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-83378c86-372b-4ce8-9d3d-cac2feba0867 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:09.467544 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-83378c86-372b-4ce8-9d3d-cac2feba0867 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:09.479110 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-83378c86-372b-4ce8-9d3d-cac2feba0867 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:09.479774 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-83378c86-372b-4ce8-9d3d-cac2feba0867 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:09.480930 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-83378c86-372b-4ce8-9d3d-cac2feba0867 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:09.481583 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-83378c86-372b-4ce8-9d3d-cac2feba0867 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:09.578924 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-019994a8-cad8-4e12-ab36-51ade0f8923a tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:09.587996 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-019994a8-cad8-4e12-ab36-51ade0f8923a tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1357 microversion: 2.1 time: 0.240171 Jul 12 17:43:09.588935 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 289/569] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:09 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1357 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:09.593839 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-651fa243-0cb0-4d7d-9115-381154a6ec30 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:09.594983 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-651fa243-0cb0-4d7d-9115-381154a6ec30 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:09.604166 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-651fa243-0cb0-4d7d-9115-381154a6ec30 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:09.604769 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-651fa243-0cb0-4d7d-9115-381154a6ec30 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:09.605683 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-651fa243-0cb0-4d7d-9115-381154a6ec30 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:09.606394 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-651fa243-0cb0-4d7d-9115-381154a6ec30 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:09.639458 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-651fa243-0cb0-4d7d-9115-381154a6ec30 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049447 Jul 12 17:43:09.640123 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-83378c86-372b-4ce8-9d3d-cac2feba0867 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:09.640287 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 290/570] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:43:09 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 17:43:09.651047 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-83378c86-372b-4ce8-9d3d-cac2feba0867 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:09.652624 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-83378c86-372b-4ce8-9d3d-cac2feba0867 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:09.653797 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-83378c86-372b-4ce8-9d3d-cac2feba0867 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1806 microversion: 2.20 time: 0.191232 Jul 12 17:43:09.654352 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 281/571] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:43:09 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1806 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:43:09.703075 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-5d8b0000-2ec7-4459-9836-07e0c741a712 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:09.703580 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-5d8b0000-2ec7-4459-9836-07e0c741a712 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:09.710943 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5d8b0000-2ec7-4459-9836-07e0c741a712 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:09.712774 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5d8b0000-2ec7-4459-9836-07e0c741a712 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:09.712774 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5d8b0000-2ec7-4459-9836-07e0c741a712 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:09.712774 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5d8b0000-2ec7-4459-9836-07e0c741a712 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:09.742567 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-5d8b0000-2ec7-4459-9836-07e0c741a712 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Going to try to terminate instance {{(pid=130059) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:43:10.036361 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-5d8b0000-2ec7-4459-9836-07e0c741a712 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "DELETE /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 204 len: 0 microversion: 2.1 time: 0.336714 Jul 12 17:43:10.037565 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 291/572] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 12 17:43:09 2022] DELETE /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:43:10.046527 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-0a3be802-9eaa-4b60-896c-ee14f6372337 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:10.047448 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-0a3be802-9eaa-4b60-896c-ee14f6372337 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:10.058244 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0a3be802-9eaa-4b60-896c-ee14f6372337 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:10.058776 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0a3be802-9eaa-4b60-896c-ee14f6372337 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:10.059597 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0a3be802-9eaa-4b60-896c-ee14f6372337 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:10.062774 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0a3be802-9eaa-4b60-896c-ee14f6372337 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:10.237151 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0a3be802-9eaa-4b60-896c-ee14f6372337 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:10.247161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-0a3be802-9eaa-4b60-896c-ee14f6372337 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 200 len: 1678 microversion: 2.1 time: 0.205353 Jul 12 17:43:10.247752 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 282/573] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:10 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 1678 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:10.485781 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-b539dc0f-f58e-4c07-811d-15ba65a02b32 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:10.487711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-b539dc0f-f58e-4c07-811d-15ba65a02b32 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:10.495250 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b539dc0f-f58e-4c07-811d-15ba65a02b32 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:10.496536 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b539dc0f-f58e-4c07-811d-15ba65a02b32 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:10.497505 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b539dc0f-f58e-4c07-811d-15ba65a02b32 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:10.497993 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b539dc0f-f58e-4c07-811d-15ba65a02b32 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:10.605956 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-0497283c-5d85-4657-a961-c105abdaefb6 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:10.606639 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-0497283c-5d85-4657-a961-c105abdaefb6 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:10.608513 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_api:SELECT=100 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:43:10.614383 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0497283c-5d85-4657-a961-c105abdaefb6 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:10.615195 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0497283c-5d85-4657-a961-c105abdaefb6 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:10.616029 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0497283c-5d85-4657-a961-c105abdaefb6 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:10.616465 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0497283c-5d85-4657-a961-c105abdaefb6 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:10.620820 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=100 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:43:10.749118 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-b539dc0f-f58e-4c07-811d-15ba65a02b32 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:10.762769 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-b539dc0f-f58e-4c07-811d-15ba65a02b32 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1314 microversion: 2.1 time: 0.282241 Jul 12 17:43:10.766616 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0497283c-5d85-4657-a961-c105abdaefb6 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:10.772743 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 292/574] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:10 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:10.775459 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-0497283c-5d85-4657-a961-c105abdaefb6 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1357 microversion: 2.1 time: 0.173375 Jul 12 17:43:10.776329 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 283/575] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:10 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:10.787267 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-045030c5-18dd-4ea4-bcf4-e2274096e2fd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:10.787948 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-045030c5-18dd-4ea4-bcf4-e2274096e2fd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:10.795454 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-045030c5-18dd-4ea4-bcf4-e2274096e2fd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:10.795990 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-045030c5-18dd-4ea4-bcf4-e2274096e2fd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:10.797011 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-045030c5-18dd-4ea4-bcf4-e2274096e2fd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:10.797662 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-045030c5-18dd-4ea4-bcf4-e2274096e2fd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:10.953535 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-045030c5-18dd-4ea4-bcf4-e2274096e2fd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:10.962746 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-045030c5-18dd-4ea4-bcf4-e2274096e2fd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:10.964266 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-045030c5-18dd-4ea4-bcf4-e2274096e2fd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:10.965434 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-045030c5-18dd-4ea4-bcf4-e2274096e2fd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1806 microversion: 2.20 time: 0.191403 Jul 12 17:43:10.965994 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 293/576] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:43:10 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1806 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:43:11.265519 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-c0ca1447-3889-4746-906c-8a4261f203b9 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:11.266140 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-c0ca1447-3889-4746-906c-8a4261f203b9 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:11.273037 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c0ca1447-3889-4746-906c-8a4261f203b9 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:11.273501 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c0ca1447-3889-4746-906c-8a4261f203b9 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:11.274286 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c0ca1447-3889-4746-906c-8a4261f203b9 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:11.274756 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c0ca1447-3889-4746-906c-8a4261f203b9 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:11.415360 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-c0ca1447-3889-4746-906c-8a4261f203b9 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:11.423042 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-c0ca1447-3889-4746-906c-8a4261f203b9 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 200 len: 1678 microversion: 2.1 time: 0.161750 Jul 12 17:43:11.423666 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 284/577] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:11 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:11.780073 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-89bbb0bd-b828-49b8-809c-2f70a10a81a5 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:11.780818 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-89bbb0bd-b828-49b8-809c-2f70a10a81a5 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:11.787668 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-89bbb0bd-b828-49b8-809c-2f70a10a81a5 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:11.788127 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-89bbb0bd-b828-49b8-809c-2f70a10a81a5 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:11.788904 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-89bbb0bd-b828-49b8-809c-2f70a10a81a5 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:11.789342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-89bbb0bd-b828-49b8-809c-2f70a10a81a5 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:11.791312 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-f4503696-672f-4752-b52f-8b86c9545b6c tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:11.792115 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-f4503696-672f-4752-b52f-8b86c9545b6c tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:11.798262 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f4503696-672f-4752-b52f-8b86c9545b6c tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:11.798693 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f4503696-672f-4752-b52f-8b86c9545b6c tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:11.799538 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f4503696-672f-4752-b52f-8b86c9545b6c tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:11.799906 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f4503696-672f-4752-b52f-8b86c9545b6c tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:11.948017 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-89bbb0bd-b828-49b8-809c-2f70a10a81a5 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:11.948186 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-f4503696-672f-4752-b52f-8b86c9545b6c tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:11.956447 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-f4503696-672f-4752-b52f-8b86c9545b6c tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1357 microversion: 2.1 time: 0.168716 Jul 12 17:43:11.958573 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 285/578] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:11 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:43:11.975383 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-89bbb0bd-b828-49b8-809c-2f70a10a81a5 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1314 microversion: 2.1 time: 0.182245 Jul 12 17:43:11.976325 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 294/579] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:11 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:11.987112 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-63c00f56-72d5-4b62-b8aa-90661ad253fa tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:11.987805 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-63c00f56-72d5-4b62-b8aa-90661ad253fa tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:11.994723 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-63c00f56-72d5-4b62-b8aa-90661ad253fa tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:11.995734 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-63c00f56-72d5-4b62-b8aa-90661ad253fa tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:11.996839 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-63c00f56-72d5-4b62-b8aa-90661ad253fa tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:12.016896 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-63c00f56-72d5-4b62-b8aa-90661ad253fa tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:12.097273 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-41d98328-9630-469b-8990-960be5d54c41 req-5d12f5c1-e50d-4880-9846-5f005aa77c0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f88418d-5f96-4c05-adf4-09d83f045699", "name": "network-vif-plugged", "status": "completed", "tag": "082490a4-d27d-40c5-93fa-92a28b71e068"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:43:12.105898 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-41d98328-9630-469b-8990-960be5d54c41 req-5d12f5c1-e50d-4880-9846-5f005aa77c0e service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:12.106592 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-41d98328-9630-469b-8990-960be5d54c41 req-5d12f5c1-e50d-4880-9846-5f005aa77c0e service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:12.120440 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-41d98328-9630-469b-8990-960be5d54c41 req-5d12f5c1-e50d-4880-9846-5f005aa77c0e service nova] Creating event network-vif-plugged:082490a4-d27d-40c5-93fa-92a28b71e068 for instance 7f88418d-5f96-4c05-adf4-09d83f045699 on hv-cinder-84875 Jul 12 17:43:12.125785 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-41d98328-9630-469b-8990-960be5d54c41 req-5d12f5c1-e50d-4880-9846-5f005aa77c0e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032360 Jul 12 17:43:12.125979 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 295/580] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:43:12.154387 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-63c00f56-72d5-4b62-b8aa-90661ad253fa tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:12.160792 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-63c00f56-72d5-4b62-b8aa-90661ad253fa tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:12.162767 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-63c00f56-72d5-4b62-b8aa-90661ad253fa tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:12.164212 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-63c00f56-72d5-4b62-b8aa-90661ad253fa tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1806 microversion: 2.20 time: 0.182248 Jul 12 17:43:12.164885 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 286/581] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:43:11 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1806 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:43:12.440713 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-b98a1488-5fbd-410b-8db6-66620f49ca51 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:12.441423 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-b98a1488-5fbd-410b-8db6-66620f49ca51 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:12.447892 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b98a1488-5fbd-410b-8db6-66620f49ca51 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:12.448334 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b98a1488-5fbd-410b-8db6-66620f49ca51 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:12.449088 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b98a1488-5fbd-410b-8db6-66620f49ca51 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:12.449524 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b98a1488-5fbd-410b-8db6-66620f49ca51 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:12.468240 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:43:12.597710 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-b98a1488-5fbd-410b-8db6-66620f49ca51 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:12.605962 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-b98a1488-5fbd-410b-8db6-66620f49ca51 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 200 len: 1678 microversion: 2.1 time: 0.169133 Jul 12 17:43:12.606848 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 296/582] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:12 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:12.982701 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-ed62d017-c860-49bb-babb-bb0b7a56ec73 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:12.983315 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-ed62d017-c860-49bb-babb-bb0b7a56ec73 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:12.991081 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ed62d017-c860-49bb-babb-bb0b7a56ec73 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:12.991531 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ed62d017-c860-49bb-babb-bb0b7a56ec73 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:12.992312 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ed62d017-c860-49bb-babb-bb0b7a56ec73 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:12.992743 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ed62d017-c860-49bb-babb-bb0b7a56ec73 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:12.996166 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-1b8172e6-6411-4700-b2a6-0071b3bec823 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:12.997005 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-1b8172e6-6411-4700-b2a6-0071b3bec823 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:13.003614 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1b8172e6-6411-4700-b2a6-0071b3bec823 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:13.010075 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1b8172e6-6411-4700-b2a6-0071b3bec823 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:13.010075 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1b8172e6-6411-4700-b2a6-0071b3bec823 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:13.010075 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1b8172e6-6411-4700-b2a6-0071b3bec823 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:13.161042 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ed62d017-c860-49bb-babb-bb0b7a56ec73 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:13.177069 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-ed62d017-c860-49bb-babb-bb0b7a56ec73 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1357 microversion: 2.1 time: 0.198488 Jul 12 17:43:13.177985 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 287/583] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:12 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1357 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:13.192646 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-1b8172e6-6411-4700-b2a6-0071b3bec823 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:13.193431 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-0743c03f-5cbb-496f-9711-69ffeaab22bd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:13.194055 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-0743c03f-5cbb-496f-9711-69ffeaab22bd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:13.200587 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0743c03f-5cbb-496f-9711-69ffeaab22bd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:13.200875 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0743c03f-5cbb-496f-9711-69ffeaab22bd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:13.201333 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-1b8172e6-6411-4700-b2a6-0071b3bec823 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1464 microversion: 2.1 time: 0.210250 Jul 12 17:43:13.201647 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0743c03f-5cbb-496f-9711-69ffeaab22bd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:13.202087 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0743c03f-5cbb-496f-9711-69ffeaab22bd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:13.213475 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 297/584] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:12 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1464 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:43:13.248253 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-421d7a25-55f2-4c4e-9a60-878a2a15e46c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:13.251133 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-421d7a25-55f2-4c4e-9a60-878a2a15e46c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:13.255707 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-421d7a25-55f2-4c4e-9a60-878a2a15e46c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:13.256193 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-421d7a25-55f2-4c4e-9a60-878a2a15e46c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:13.256968 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-421d7a25-55f2-4c4e-9a60-878a2a15e46c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:13.257401 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-421d7a25-55f2-4c4e-9a60-878a2a15e46c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:13.283378 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-421d7a25-55f2-4c4e-9a60-878a2a15e46c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Going to try to terminate instance {{(pid=130059) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:43:13.372165 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0743c03f-5cbb-496f-9711-69ffeaab22bd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:13.381758 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0743c03f-5cbb-496f-9711-69ffeaab22bd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:13.383308 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0743c03f-5cbb-496f-9711-69ffeaab22bd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:13.384462 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-0743c03f-5cbb-496f-9711-69ffeaab22bd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1806 microversion: 2.20 time: 0.196014 Jul 12 17:43:13.385020 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 288/585] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:43:13 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1806 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:43:13.596504 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-421d7a25-55f2-4c4e-9a60-878a2a15e46c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 204 len: 0 microversion: 2.1 time: 0.352184 Jul 12 17:43:13.597509 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 298/586] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 12 17:43:13 2022] DELETE /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:43:13.606394 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-12a399b2-e9d1-40b7-bab9-6361e7d4ce82 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:13.607313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-12a399b2-e9d1-40b7-bab9-6361e7d4ce82 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:13.614384 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-12a399b2-e9d1-40b7-bab9-6361e7d4ce82 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:13.620859 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-12a399b2-e9d1-40b7-bab9-6361e7d4ce82 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:13.620859 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-12a399b2-e9d1-40b7-bab9-6361e7d4ce82 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:13.620859 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-12a399b2-e9d1-40b7-bab9-6361e7d4ce82 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:13.624444 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-8f701ab8-eaf2-49e8-b088-335c1da320c3 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:13.625162 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-8f701ab8-eaf2-49e8-b088-335c1da320c3 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:13.634608 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8f701ab8-eaf2-49e8-b088-335c1da320c3 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:13.635540 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8f701ab8-eaf2-49e8-b088-335c1da320c3 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:13.637242 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8f701ab8-eaf2-49e8-b088-335c1da320c3 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:13.640270 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8f701ab8-eaf2-49e8-b088-335c1da320c3 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:13.832901 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-8f701ab8-eaf2-49e8-b088-335c1da320c3 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:13.841958 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-8f701ab8-eaf2-49e8-b088-335c1da320c3 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 200 len: 1678 microversion: 2.1 time: 0.221820 Jul 12 17:43:13.850078 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 299/587] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:13 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 1678 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:43:13.940271 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-12a399b2-e9d1-40b7-bab9-6361e7d4ce82 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:13.951845 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-12a399b2-e9d1-40b7-bab9-6361e7d4ce82 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1470 microversion: 2.1 time: 0.349435 Jul 12 17:43:13.961431 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 289/588] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:13 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1470 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:14.200304 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a71dc08b-f6a4-47de-8981-3e5d79526767 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:14.201542 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-a71dc08b-f6a4-47de-8981-3e5d79526767 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:14.225667 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a71dc08b-f6a4-47de-8981-3e5d79526767 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:14.233378 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a71dc08b-f6a4-47de-8981-3e5d79526767 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:14.238031 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a71dc08b-f6a4-47de-8981-3e5d79526767 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:14.239045 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a71dc08b-f6a4-47de-8981-3e5d79526767 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:14.403642 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-2be742ff-a4a7-4100-aa9f-7defcec9c091 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:14.404247 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-2be742ff-a4a7-4100-aa9f-7defcec9c091 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:14.411269 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2be742ff-a4a7-4100-aa9f-7defcec9c091 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:14.411759 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2be742ff-a4a7-4100-aa9f-7defcec9c091 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:14.412544 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2be742ff-a4a7-4100-aa9f-7defcec9c091 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:14.413014 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2be742ff-a4a7-4100-aa9f-7defcec9c091 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:14.507084 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a71dc08b-f6a4-47de-8981-3e5d79526767 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:14.513321 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-a71dc08b-f6a4-47de-8981-3e5d79526767 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1357 microversion: 2.1 time: 0.322596 Jul 12 17:43:14.523876 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 300/589] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:14 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1357 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:14.560383 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-2be742ff-a4a7-4100-aa9f-7defcec9c091 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:14.571222 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-2be742ff-a4a7-4100-aa9f-7defcec9c091 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:14.572792 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-2be742ff-a4a7-4100-aa9f-7defcec9c091 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:14.574281 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-2be742ff-a4a7-4100-aa9f-7defcec9c091 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1806 microversion: 2.20 time: 0.174500 Jul 12 17:43:14.575070 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 290/590] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:43:14 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:43:14.859818 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a6707b43-4a59-4473-ac6d-d5ba462ca6f1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:14.860546 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-a6707b43-4a59-4473-ac6d-d5ba462ca6f1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:14.867830 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a6707b43-4a59-4473-ac6d-d5ba462ca6f1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:14.868379 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a6707b43-4a59-4473-ac6d-d5ba462ca6f1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:14.869242 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a6707b43-4a59-4473-ac6d-d5ba462ca6f1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:14.869751 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a6707b43-4a59-4473-ac6d-d5ba462ca6f1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:14.976232 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-e7d3603f-6c47-4dba-9249-b89d7655f06c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:14.976485 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-e7d3603f-6c47-4dba-9249-b89d7655f06c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:14.983662 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e7d3603f-6c47-4dba-9249-b89d7655f06c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:14.984115 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e7d3603f-6c47-4dba-9249-b89d7655f06c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:14.984895 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e7d3603f-6c47-4dba-9249-b89d7655f06c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:14.985333 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e7d3603f-6c47-4dba-9249-b89d7655f06c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:15.048526 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a6707b43-4a59-4473-ac6d-d5ba462ca6f1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:15.059396 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-a6707b43-4a59-4473-ac6d-d5ba462ca6f1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 200 len: 1678 microversion: 2.1 time: 0.202896 Jul 12 17:43:15.060007 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 301/591] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:14 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 1678 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:15.156602 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-e7d3603f-6c47-4dba-9249-b89d7655f06c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:15.169701 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-e7d3603f-6c47-4dba-9249-b89d7655f06c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1470 microversion: 2.1 time: 0.198818 Jul 12 17:43:15.170589 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 291/592] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:14 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1470 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:43:15.541526 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-e6c0d3a9-654f-4fdd-816f-57d3e452041e tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:15.545790 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-e6c0d3a9-654f-4fdd-816f-57d3e452041e tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:15.575676 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e6c0d3a9-654f-4fdd-816f-57d3e452041e tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:15.576639 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e6c0d3a9-654f-4fdd-816f-57d3e452041e tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:15.577983 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e6c0d3a9-654f-4fdd-816f-57d3e452041e tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:15.578785 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e6c0d3a9-654f-4fdd-816f-57d3e452041e tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:15.595853 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-2a42eee6-8605-494d-8edc-4b4dbf473150 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:15.596470 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-2a42eee6-8605-494d-8edc-4b4dbf473150 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:15.606040 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2a42eee6-8605-494d-8edc-4b4dbf473150 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:15.606919 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2a42eee6-8605-494d-8edc-4b4dbf473150 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:15.608183 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2a42eee6-8605-494d-8edc-4b4dbf473150 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:15.608941 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2a42eee6-8605-494d-8edc-4b4dbf473150 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:15.758024 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-e6c0d3a9-654f-4fdd-816f-57d3e452041e tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:15.766932 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-e6c0d3a9-654f-4fdd-816f-57d3e452041e tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1357 microversion: 2.1 time: 0.239483 Jul 12 17:43:15.767535 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 302/593] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:15 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1357 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:15.794309 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-8b10b49a-50c7-48cd-9324-80b9077f4599 req-a7ebbee5-fac5-4def-ada8-63b3de23722f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edf55e8a-cbc1-45b6-a138-21d5a07301d9", "name": "network-vif-deleted", "tag": "e8c8b0fc-808c-4c82-a0f6-91314b49f8a9"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:43:15.820506 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-8b10b49a-50c7-48cd-9324-80b9077f4599 req-a7ebbee5-fac5-4def-ada8-63b3de23722f service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:15.822704 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-8b10b49a-50c7-48cd-9324-80b9077f4599 req-a7ebbee5-fac5-4def-ada8-63b3de23722f service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:15.838849 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-2a42eee6-8605-494d-8edc-4b4dbf473150 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:15.852191 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-2a42eee6-8605-494d-8edc-4b4dbf473150 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:15.854166 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-2a42eee6-8605-494d-8edc-4b4dbf473150 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:15.855671 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-2a42eee6-8605-494d-8edc-4b4dbf473150 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1806 microversion: 2.20 time: 0.263691 Jul 12 17:43:15.857866 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-8b10b49a-50c7-48cd-9324-80b9077f4599 req-a7ebbee5-fac5-4def-ada8-63b3de23722f service nova] Creating event network-vif-deleted:e8c8b0fc-808c-4c82-a0f6-91314b49f8a9 for instance edf55e8a-cbc1-45b6-a138-21d5a07301d9 on hv-cinder-84875 Jul 12 17:43:15.859209 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 292/594] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:43:15 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1806 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:43:15.869176 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-8b10b49a-50c7-48cd-9324-80b9077f4599 req-a7ebbee5-fac5-4def-ada8-63b3de23722f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087383 Jul 12 17:43:15.869789 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 303/595] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:43:16.088321 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-0084e586-ba1e-4f57-b6d7-fafb2d8a8b3a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:16.090338 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-0084e586-ba1e-4f57-b6d7-fafb2d8a8b3a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:16.100327 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0084e586-ba1e-4f57-b6d7-fafb2d8a8b3a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:16.101116 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0084e586-ba1e-4f57-b6d7-fafb2d8a8b3a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:16.102475 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0084e586-ba1e-4f57-b6d7-fafb2d8a8b3a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:16.103320 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0084e586-ba1e-4f57-b6d7-fafb2d8a8b3a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:16.176971 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0084e586-ba1e-4f57-b6d7-fafb2d8a8b3a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:16.187187 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-0084e586-ba1e-4f57-b6d7-fafb2d8a8b3a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 200 len: 1326 microversion: 2.1 time: 0.104835 Jul 12 17:43:16.187711 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 293/596] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:16 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 1326 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:16.201645 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-8b06c02f-3f0e-4875-9266-ba270c6a5764 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:16.202542 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-8b06c02f-3f0e-4875-9266-ba270c6a5764 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:16.210748 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8b06c02f-3f0e-4875-9266-ba270c6a5764 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:16.211548 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8b06c02f-3f0e-4875-9266-ba270c6a5764 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:16.212410 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8b06c02f-3f0e-4875-9266-ba270c6a5764 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:16.212936 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8b06c02f-3f0e-4875-9266-ba270c6a5764 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:16.428441 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-57822df7-c0db-4ec1-a7a4-e3993bc78610 req-0abacb50-4824-4eaf-84f9-57e84ff9571e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d57de92-32ca-4ff9-a5ea-00d7e83bbf72", "name": "network-vif-plugged", "status": "completed", "tag": "c4901ed1-f277-462c-b8b5-c19838c33e73"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:43:16.431521 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-8b06c02f-3f0e-4875-9266-ba270c6a5764 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:16.438584 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-57822df7-c0db-4ec1-a7a4-e3993bc78610 req-0abacb50-4824-4eaf-84f9-57e84ff9571e service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:16.447933 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-57822df7-c0db-4ec1-a7a4-e3993bc78610 req-0abacb50-4824-4eaf-84f9-57e84ff9571e service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:16.448074 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-8b06c02f-3f0e-4875-9266-ba270c6a5764 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1470 microversion: 2.1 time: 0.256634 Jul 12 17:43:16.448074 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 304/597] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:16 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1470 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:16.452577 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-57822df7-c0db-4ec1-a7a4-e3993bc78610 req-0abacb50-4824-4eaf-84f9-57e84ff9571e service nova] Creating event network-vif-plugged:c4901ed1-f277-462c-b8b5-c19838c33e73 for instance 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 on hv-cinder-84875 Jul 12 17:43:16.458479 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-57822df7-c0db-4ec1-a7a4-e3993bc78610 req-0abacb50-4824-4eaf-84f9-57e84ff9571e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034669 Jul 12 17:43:16.459393 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 294/598] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:43:16.787442 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-c8e485d8-a0a1-48fa-b57f-702090a8887d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:16.788428 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-c8e485d8-a0a1-48fa-b57f-702090a8887d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:16.795509 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c8e485d8-a0a1-48fa-b57f-702090a8887d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:16.795970 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c8e485d8-a0a1-48fa-b57f-702090a8887d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:16.796752 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c8e485d8-a0a1-48fa-b57f-702090a8887d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:16.797195 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c8e485d8-a0a1-48fa-b57f-702090a8887d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:16.881400 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-97a98931-6ce0-4c70-959a-193d15617c37 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:16.884036 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-97a98931-6ce0-4c70-959a-193d15617c37 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:16.899613 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-97a98931-6ce0-4c70-959a-193d15617c37 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:16.900392 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-97a98931-6ce0-4c70-959a-193d15617c37 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:16.905685 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-97a98931-6ce0-4c70-959a-193d15617c37 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:16.906895 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-97a98931-6ce0-4c70-959a-193d15617c37 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:17.033995 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-c8e485d8-a0a1-48fa-b57f-702090a8887d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:17.043844 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-c8e485d8-a0a1-48fa-b57f-702090a8887d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1357 microversion: 2.1 time: 0.262297 Jul 12 17:43:17.044782 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 305/599] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:16 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1357 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:17.187752 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-97a98931-6ce0-4c70-959a-193d15617c37 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:17.203151 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-97a98931-6ce0-4c70-959a-193d15617c37 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:17.205353 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-97a98931-6ce0-4c70-959a-193d15617c37 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:17.206471 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-4585f7ac-a115-427c-8678-6afbd704d62f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:17.206595 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-97a98931-6ce0-4c70-959a-193d15617c37 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1806 microversion: 2.20 time: 0.335634 Jul 12 17:43:17.207972 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 295/600] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:43:16 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1806 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:43:17.216111 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-4585f7ac-a115-427c-8678-6afbd704d62f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:17.224017 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4585f7ac-a115-427c-8678-6afbd704d62f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:17.224538 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4585f7ac-a115-427c-8678-6afbd704d62f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:17.225393 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4585f7ac-a115-427c-8678-6afbd704d62f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:17.225918 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4585f7ac-a115-427c-8678-6afbd704d62f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:17.262486 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4585f7ac-a115-427c-8678-6afbd704d62f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:17.263024 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4585f7ac-a115-427c-8678-6afbd704d62f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:17.263734 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.objects.instance [None req-4585f7ac-a115-427c-8678-6afbd704d62f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lazy-loading 'fault' on Instance uuid edf55e8a-cbc1-45b6-a138-21d5a07301d9 {{(pid=130059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:43:17.312829 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-4585f7ac-a115-427c-8678-6afbd704d62f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:17.321624 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-4585f7ac-a115-427c-8678-6afbd704d62f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 200 len: 1331 microversion: 2.1 time: 0.119756 Jul 12 17:43:17.322204 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 306/601] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:17 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 1331 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:43:17.457398 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-d2439f0f-331b-4f14-86ec-7b88138f2f07 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:17.458213 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-d2439f0f-331b-4f14-86ec-7b88138f2f07 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:17.477778 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d2439f0f-331b-4f14-86ec-7b88138f2f07 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:17.478241 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d2439f0f-331b-4f14-86ec-7b88138f2f07 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:17.481727 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d2439f0f-331b-4f14-86ec-7b88138f2f07 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:17.481727 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d2439f0f-331b-4f14-86ec-7b88138f2f07 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:17.518641 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-f175a621-a3de-4910-91c4-8fe3b25dccd7 req-dd3b5d18-7647-43c4-979c-2831af2625f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e97f8453-690a-4d27-8061-81007783d32a", "name": "network-vif-deleted", "tag": "6a7159ad-dc9e-4e19-93f7-f60cb2d94a73"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:43:17.527787 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-f175a621-a3de-4910-91c4-8fe3b25dccd7 req-dd3b5d18-7647-43c4-979c-2831af2625f2 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:17.528275 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-f175a621-a3de-4910-91c4-8fe3b25dccd7 req-dd3b5d18-7647-43c4-979c-2831af2625f2 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:17.542592 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-f175a621-a3de-4910-91c4-8fe3b25dccd7 req-dd3b5d18-7647-43c4-979c-2831af2625f2 service nova] Creating event network-vif-deleted:6a7159ad-dc9e-4e19-93f7-f60cb2d94a73 for instance e97f8453-690a-4d27-8061-81007783d32a on hv-cinder-84875 Jul 12 17:43:17.548104 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-f175a621-a3de-4910-91c4-8fe3b25dccd7 req-dd3b5d18-7647-43c4-979c-2831af2625f2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033103 Jul 12 17:43:17.548886 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 307/602] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:43:17.565208 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-d2439f0f-331b-4f14-86ec-7b88138f2f07 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:17.576479 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-d2439f0f-331b-4f14-86ec-7b88138f2f07 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1428 microversion: 2.1 time: 0.123085 Jul 12 17:43:17.577325 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 296/603] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:17 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1428 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:18.065070 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a6f7b845-0c8e-4c61-9cbc-1cc9aa59a605 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:18.065777 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-a6f7b845-0c8e-4c61-9cbc-1cc9aa59a605 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:18.072960 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a6f7b845-0c8e-4c61-9cbc-1cc9aa59a605 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:18.073418 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a6f7b845-0c8e-4c61-9cbc-1cc9aa59a605 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:18.074213 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a6f7b845-0c8e-4c61-9cbc-1cc9aa59a605 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:18.074680 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a6f7b845-0c8e-4c61-9cbc-1cc9aa59a605 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:18.227243 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-3a41ea53-5713-443f-b9db-7f97b38ffc10 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:18.228113 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-3a41ea53-5713-443f-b9db-7f97b38ffc10 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:18.231076 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a6f7b845-0c8e-4c61-9cbc-1cc9aa59a605 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:18.235450 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3a41ea53-5713-443f-b9db-7f97b38ffc10 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:18.236183 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3a41ea53-5713-443f-b9db-7f97b38ffc10 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:18.237121 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3a41ea53-5713-443f-b9db-7f97b38ffc10 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:18.237651 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3a41ea53-5713-443f-b9db-7f97b38ffc10 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:18.241043 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-a6f7b845-0c8e-4c61-9cbc-1cc9aa59a605 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1357 microversion: 2.1 time: 0.183355 Jul 12 17:43:18.241942 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 308/604] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:18 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:18.345908 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-42fa7315-6025-4cca-8813-cb9ac76ce14b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:18.345908 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-42fa7315-6025-4cca-8813-cb9ac76ce14b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:18.348364 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-42fa7315-6025-4cca-8813-cb9ac76ce14b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:18.348902 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-42fa7315-6025-4cca-8813-cb9ac76ce14b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:18.350201 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-42fa7315-6025-4cca-8813-cb9ac76ce14b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:18.350884 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-42fa7315-6025-4cca-8813-cb9ac76ce14b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:18.397767 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-3a41ea53-5713-443f-b9db-7f97b38ffc10 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:18.400712 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-42fa7315-6025-4cca-8813-cb9ac76ce14b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:18.401174 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-42fa7315-6025-4cca-8813-cb9ac76ce14b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:18.401629 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.objects.instance [None req-42fa7315-6025-4cca-8813-cb9ac76ce14b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lazy-loading 'fault' on Instance uuid edf55e8a-cbc1-45b6-a138-21d5a07301d9 {{(pid=130059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:43:18.407103 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-3a41ea53-5713-443f-b9db-7f97b38ffc10 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:18.417235 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-3a41ea53-5713-443f-b9db-7f97b38ffc10 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:18.417235 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-3a41ea53-5713-443f-b9db-7f97b38ffc10 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1806 microversion: 2.20 time: 0.187308 Jul 12 17:43:18.417235 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 297/605] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:43:18 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1806 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:43:18.443676 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-42fa7315-6025-4cca-8813-cb9ac76ce14b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:18.451828 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-42fa7315-6025-4cca-8813-cb9ac76ce14b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 200 len: 1331 microversion: 2.1 time: 0.116232 Jul 12 17:43:18.452696 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 309/606] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:18 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 1331 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:43:18.593833 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-a1b02b3a-39d6-400b-b19a-09295f49695e tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:18.594491 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-a1b02b3a-39d6-400b-b19a-09295f49695e tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:18.600825 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a1b02b3a-39d6-400b-b19a-09295f49695e tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:18.602939 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a1b02b3a-39d6-400b-b19a-09295f49695e tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:18.603489 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a1b02b3a-39d6-400b-b19a-09295f49695e tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:18.604361 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a1b02b3a-39d6-400b-b19a-09295f49695e tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:18.649573 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a1b02b3a-39d6-400b-b19a-09295f49695e tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:18.650032 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a1b02b3a-39d6-400b-b19a-09295f49695e tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:18.650528 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.objects.instance [None req-a1b02b3a-39d6-400b-b19a-09295f49695e tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lazy-loading 'fault' on Instance uuid e97f8453-690a-4d27-8061-81007783d32a {{(pid=130058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:43:18.703158 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-a1b02b3a-39d6-400b-b19a-09295f49695e tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:18.711509 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-a1b02b3a-39d6-400b-b19a-09295f49695e tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1304 microversion: 2.1 time: 0.121618 Jul 12 17:43:18.712087 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 298/607] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:18 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:19.258754 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a93f5527-65e8-4f3e-9aee-195374533a2c tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:19.259377 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-a93f5527-65e8-4f3e-9aee-195374533a2c tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:19.268229 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a93f5527-65e8-4f3e-9aee-195374533a2c tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:19.269097 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a93f5527-65e8-4f3e-9aee-195374533a2c tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:19.269509 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a93f5527-65e8-4f3e-9aee-195374533a2c tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:19.270056 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a93f5527-65e8-4f3e-9aee-195374533a2c tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:19.426267 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a93f5527-65e8-4f3e-9aee-195374533a2c tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:19.430366 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-494c7015-fb92-4caa-8bb8-e37dec2beac6 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:19.431083 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-494c7015-fb92-4caa-8bb8-e37dec2beac6 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:19.435693 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-a93f5527-65e8-4f3e-9aee-195374533a2c tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1357 microversion: 2.1 time: 0.180969 Jul 12 17:43:19.436330 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 310/608] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:19 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:19.440735 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-494c7015-fb92-4caa-8bb8-e37dec2beac6 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:19.442184 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-494c7015-fb92-4caa-8bb8-e37dec2beac6 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:19.442668 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-494c7015-fb92-4caa-8bb8-e37dec2beac6 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:19.443412 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-494c7015-fb92-4caa-8bb8-e37dec2beac6 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:19.469322 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ae0b2397-9241-4201-a68b-06519351035f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:19.473117 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-ae0b2397-9241-4201-a68b-06519351035f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:19.477596 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ae0b2397-9241-4201-a68b-06519351035f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:19.478255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ae0b2397-9241-4201-a68b-06519351035f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:19.479024 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ae0b2397-9241-4201-a68b-06519351035f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:19.479531 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ae0b2397-9241-4201-a68b-06519351035f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:19.496456 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-ae0b2397-9241-4201-a68b-06519351035f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] HTTP exception thrown: Instance edf55e8a-cbc1-45b6-a138-21d5a07301d9 could not be found. Jul 12 17:43:19.498289 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ae0b2397-9241-4201-a68b-06519351035f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Request method failure captured: Jul 12 17:43:19.498289 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 HTTP/1.1 Jul 12 17:43:19.498289 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:43:19.498289 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:43:19.498289 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:43:19.498289 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 0 Jul 12 17:43:19.498289 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:43:19.498289 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:43:19.498289 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:43:19.498289 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:43:19.498289 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbHIKPX81cOSzuTp0O3vMBUQ_2pscgJx1VEp1s8R65yvOz2oUKOjUaqFlJmNQdapSExRqaTx7so1aRxIG_vuYNvJ_o-Kb6m698uGIk6QmB9ep_Ed50ORq5_o-D700OCaKd2Eu3BHwptAzFT8ZMufAhu8lzyW1do401lCvRn-uiuATyM Jul 12 17:43:19.498289 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:43:19.498289 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:43:19.498289 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:43:19.498289 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:43:19.498289 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:43:19.498289 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:43:19.498289 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: 84b840eaa59d4f73ac68926437f03d82 Jul 12 17:43:19.498289 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:43:19.498289 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:43:19.498289 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:43:19.499654 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84b840eaa59d4f73ac68926437f03d82", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:43:19.499654 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:43:19.499654 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: 84b840eaa59d4f73ac68926437f03d82 Jul 12 17:43:19.499654 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:43:19.499654 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-AttachVolumeNegativeTest-834922830-project Jul 12 17:43:19.499654 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:43:19.499654 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:43:19.499654 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: c8441a4a72154ee3bbb95af66abf2ffd Jul 12 17:43:19.499654 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-AttachVolumeNegativeTest-834922830-project Jul 12 17:43:19.499654 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: > Jul 12 17:43:19.499654 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Instance edf55e8a-cbc1-45b6-a138-21d5a07301d9 could not be found. Jul 12 17:43:19.499654 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'id': 'edf55e8a-cbc1-45b6-a138-21d5a07301d9'} Jul 12 17:43:19.500402 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:43:19.500402 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:43:19.500402 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:43:19.500402 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:43:19.500402 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:43:19.500402 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:43:19.500402 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:43:19.500402 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:43:19.500402 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:43:19.500402 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:43:19.500402 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edf55e8a-cbc1-45b6-a138-21d5a07301d9 could not be found. Jul 12 17:43:19.500402 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:43:19.500402 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:43:19.500402 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:43:19.500402 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:43:19.500402 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:43:19.500402 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:43:19.500402 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:43:19.500402 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:43:19.500402 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:43:19.501646 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:43:19.501646 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:43:19.501646 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:43:19.501646 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:43:19.501646 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:43:19.501646 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:43:19.501646 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:43:19.501646 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edf55e8a-cbc1-45b6-a138-21d5a07301d9 could not be found. Jul 12 17:43:19.501646 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:43:19.501646 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:43:19.501646 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:43:19.501646 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:43:19.501646 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:43:19.501646 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:43:19.501646 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:43:19.501646 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:43:19.501646 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edf55e8a-cbc1-45b6-a138-21d5a07301d9 could not be found. Jul 12 17:43:19.501646 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:43:19.513232 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ae0b2397-9241-4201-a68b-06519351035f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Returning 404 to user: Instance edf55e8a-cbc1-45b6-a138-21d5a07301d9 could not be found. {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:43:19.513232 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-ae0b2397-9241-4201-a68b-06519351035f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 404 len: 111 microversion: 2.1 time: 0.034326 Jul 12 17:43:19.513232 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 311/609] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:19 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 17:43:19.513232 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a816faf6-1a2b-4543-b8ae-537b5914d032 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '.version_select at 0x7f479fce94c0>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:19.603063 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-a816faf6-1a2b-4543-b8ae-537b5914d032 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1075727624" status: 202 len: 0 microversion: 2.1 time: 0.097662 Jul 12 17:43:19.603850 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 312/610] 10.222.0.16 () {58 vars in 1220 bytes} [Tue Jul 12 17:43:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1075727624 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 17:43:19.615054 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-494c7015-fb92-4caa-8bb8-e37dec2beac6 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:19.636858 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-494c7015-fb92-4caa-8bb8-e37dec2beac6 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:19.638913 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-494c7015-fb92-4caa-8bb8-e37dec2beac6 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:19.640127 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-494c7015-fb92-4caa-8bb8-e37dec2beac6 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1806 microversion: 2.20 time: 0.214786 Jul 12 17:43:19.640712 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 299/611] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:43:19 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1806 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:43:19.730122 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a66c5616-fefb-4eaf-92a6-51efc56d3569 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:19.730759 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-a66c5616-fefb-4eaf-92a6-51efc56d3569 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:19.737049 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a66c5616-fefb-4eaf-92a6-51efc56d3569 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:19.737506 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a66c5616-fefb-4eaf-92a6-51efc56d3569 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:19.738549 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a66c5616-fefb-4eaf-92a6-51efc56d3569 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:19.739056 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a66c5616-fefb-4eaf-92a6-51efc56d3569 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:19.772393 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a66c5616-fefb-4eaf-92a6-51efc56d3569 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:19.772774 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a66c5616-fefb-4eaf-92a6-51efc56d3569 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:19.773229 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.objects.instance [None req-a66c5616-fefb-4eaf-92a6-51efc56d3569 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lazy-loading 'fault' on Instance uuid e97f8453-690a-4d27-8061-81007783d32a {{(pid=130059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:43:19.776307 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:43:19.814686 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a66c5616-fefb-4eaf-92a6-51efc56d3569 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:19.822820 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-a66c5616-fefb-4eaf-92a6-51efc56d3569 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1304 microversion: 2.1 time: 0.096775 Jul 12 17:43:19.823470 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 313/612] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:19 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:20.445287 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b9050f16-7344-487f-b71a-f936e24768ea tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Action: 'create', calling method: .version_select at 0x7f479fda1f70>, body: {"keypair": {"name": "tempest-keypair-1691053878", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+86z3Zw2xXVmKw76No68AkT1moWLvOs+6qa/OXK9x96wT+zGd5d4nTJB19xA+cikqvwU+9Zz4JW94YRCDZrATpkTAU9QYtKLmqRngqz78eHXidPTb80MpQ490aNyV9aA=="}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:43:20.456703 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-b1b476ff-d671-4f57-9f77-8ad345029c35 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:20.457683 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-b1b476ff-d671-4f57-9f77-8ad345029c35 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:20.461042 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:43:20.463483 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-b9050f16-7344-487f-b71a-f936e24768ea tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Getting quotas for project 84b840eaa59d4f73ac68926437f03d82. Resources: {'key_pairs'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:43:20.468136 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-b9050f16-7344-487f-b71a-f936e24768ea tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Getting quotas for user c8441a4a72154ee3bbb95af66abf2ffd and project 84b840eaa59d4f73ac68926437f03d82. Resources: {'key_pairs'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:43:20.469515 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b1b476ff-d671-4f57-9f77-8ad345029c35 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:20.469643 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b1b476ff-d671-4f57-9f77-8ad345029c35 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:20.470586 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b1b476ff-d671-4f57-9f77-8ad345029c35 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:20.471152 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b1b476ff-d671-4f57-9f77-8ad345029c35 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:20.554058 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-b9050f16-7344-487f-b71a-f936e24768ea tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.113096 Jul 12 17:43:20.555687 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 300/613] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Jul 12 17:43:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:43:20.628683 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-b1b476ff-d671-4f57-9f77-8ad345029c35 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:20.637037 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-b1b476ff-d671-4f57-9f77-8ad345029c35 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1357 microversion: 2.1 time: 0.187223 Jul 12 17:43:20.637628 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 314/614] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:20 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:43:20.659523 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b5174cb0-71f1-4e64-8255-924c8f89a826 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:20.659931 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-b5174cb0-71f1-4e64-8255-924c8f89a826 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:20.666907 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b5174cb0-71f1-4e64-8255-924c8f89a826 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:20.667360 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b5174cb0-71f1-4e64-8255-924c8f89a826 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:20.668136 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b5174cb0-71f1-4e64-8255-924c8f89a826 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:20.668573 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b5174cb0-71f1-4e64-8255-924c8f89a826 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:20.671579 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=100 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:43:20.841824 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-812ec962-829e-4e75-8c01-3a9844de779c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:20.842482 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-812ec962-829e-4e75-8c01-3a9844de779c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:20.846160 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-b5174cb0-71f1-4e64-8255-924c8f89a826 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:20.852076 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-812ec962-829e-4e75-8c01-3a9844de779c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:20.852540 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-812ec962-829e-4e75-8c01-3a9844de779c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:20.853472 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-812ec962-829e-4e75-8c01-3a9844de779c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:20.853955 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-812ec962-829e-4e75-8c01-3a9844de779c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:20.856288 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-b5174cb0-71f1-4e64-8255-924c8f89a826 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:20.858101 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-b5174cb0-71f1-4e64-8255-924c8f89a826 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:20.859343 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-b5174cb0-71f1-4e64-8255-924c8f89a826 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1793 microversion: 2.20 time: 0.204123 Jul 12 17:43:20.859921 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 301/615] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:43:20 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1793 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:43:20.889926 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-812ec962-829e-4e75-8c01-3a9844de779c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:20.890169 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-812ec962-829e-4e75-8c01-3a9844de779c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:20.890519 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.objects.instance [None req-812ec962-829e-4e75-8c01-3a9844de779c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lazy-loading 'fault' on Instance uuid e97f8453-690a-4d27-8061-81007783d32a {{(pid=130059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:43:20.941764 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-812ec962-829e-4e75-8c01-3a9844de779c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b076f0335184c22a2aa07bf484c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019d9f28339c4316bb3cda3e4c6ea908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:20.950836 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-812ec962-829e-4e75-8c01-3a9844de779c tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 200 len: 1304 microversion: 2.1 time: 0.113863 Jul 12 17:43:20.951406 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 315/616] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:20 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 1304 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:43:21.654900 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-5794fbdb-3165-4b83-8721-0c964806533d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:21.655503 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-5794fbdb-3165-4b83-8721-0c964806533d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:21.662701 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5794fbdb-3165-4b83-8721-0c964806533d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:21.663148 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5794fbdb-3165-4b83-8721-0c964806533d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:21.663913 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5794fbdb-3165-4b83-8721-0c964806533d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:21.664343 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5794fbdb-3165-4b83-8721-0c964806533d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:21.838871 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-5794fbdb-3165-4b83-8721-0c964806533d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:21.848462 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-5794fbdb-3165-4b83-8721-0c964806533d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1548 microversion: 2.1 time: 0.197480 Jul 12 17:43:21.849064 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 302/617] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:21 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1548 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:21.865805 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-88773613-afe5-44f1-a538-fcfb52578f94 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:21.866420 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-88773613-afe5-44f1-a538-fcfb52578f94 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:21.873222 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-88773613-afe5-44f1-a538-fcfb52578f94 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:21.873667 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-88773613-afe5-44f1-a538-fcfb52578f94 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:21.874450 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-88773613-afe5-44f1-a538-fcfb52578f94 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:21.874900 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-88773613-afe5-44f1-a538-fcfb52578f94 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:21.979929 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-2cbc142b-1fdc-480a-a888-a570d1d41498 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:21.980560 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-2cbc142b-1fdc-480a-a888-a570d1d41498 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] [instance: e97f8453-690a-4d27-8061-81007783d32a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:21.986896 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2cbc142b-1fdc-480a-a888-a570d1d41498 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:21.987350 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2cbc142b-1fdc-480a-a888-a570d1d41498 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:21.988637 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2cbc142b-1fdc-480a-a888-a570d1d41498 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:21.989078 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2cbc142b-1fdc-480a-a888-a570d1d41498 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:22.003482 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.wsgi [None req-2cbc142b-1fdc-480a-a888-a570d1d41498 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] HTTP exception thrown: Instance e97f8453-690a-4d27-8061-81007783d32a could not be found. Jul 12 17:43:22.008040 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-2cbc142b-1fdc-480a-a888-a570d1d41498 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Request method failure captured: Jul 12 17:43:22.008040 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: request: GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a HTTP/1.1 Jul 12 17:43:22.008040 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept: application/json Jul 12 17:43:22.008040 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept-Encoding: identity Jul 12 17:43:22.008040 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Connection: close Jul 12 17:43:22.008040 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Length: 0 Jul 12 17:43:22.008040 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Type: application/json Jul 12 17:43:22.008040 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Host: 10.222.0.16 Jul 12 17:43:22.008040 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Openstack-System-Scope: None Jul 12 17:43:22.008040 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: User-Agent: python-urllib3/1.26.9 Jul 12 17:43:22.008040 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Auth-Token: gAAAAABizbJ8zeZH1-7cII-BoAVAW1bvb_lYGPFG4GDvmaEtansDArsCkyLlUqrabECK3glw_SEAfSIpLYM0kKMqlX0QNTFhOyIxFD1PmqZZ-MsNASdR8EezuVK3WIQljvbFRCDOf1gT9wuu7NvEfhgrkvgfhHd2lLfXrivnoNJgH1wCjnaFUcU Jul 12 17:43:22.008040 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Id: None Jul 12 17:43:22.008040 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Name: None Jul 12 17:43:22.008040 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Identity-Status: Confirmed Jul 12 17:43:22.008040 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Is-Admin-Project: True Jul 12 17:43:22.008040 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Id: default Jul 12 17:43:22.008040 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Name: Default Jul 12 17:43:22.008040 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Id: 019d9f28339c4316bb3cda3e4c6ea908 Jul 12 17:43:22.008040 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Name: tempest-VolumesNegativeTest-1762592972 Jul 12 17:43:22.008040 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Role: reader,member Jul 12 17:43:22.008040 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Roles: reader,member Jul 12 17:43:22.009571 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/019d9f28339c4316bb3cda3e4c6ea908"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_019d9f28339c4316bb3cda3e4c6ea908", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/019d9f28339c4316bb3cda3e4c6ea908"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/019d9f28339c4316bb3cda3e4c6ea908"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:43:22.009571 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant: tempest-VolumesNegativeTest-1762592972 Jul 12 17:43:22.009571 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Id: 019d9f28339c4316bb3cda3e4c6ea908 Jul 12 17:43:22.009571 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Name: tempest-VolumesNegativeTest-1762592972 Jul 12 17:43:22.009571 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User: tempest-VolumesNegativeTest-1762592972-project Jul 12 17:43:22.009571 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Id: default Jul 12 17:43:22.009571 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Name: Default Jul 12 17:43:22.009571 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Id: 7b076f0335184c22a2aa07bf484c631e Jul 12 17:43:22.009571 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Name: tempest-VolumesNegativeTest-1762592972-project Jul 12 17:43:22.009571 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: method: > Jul 12 17:43:22.009571 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: exception: Instance e97f8453-690a-4d27-8061-81007783d32a could not be found. Jul 12 17:43:22.009571 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: action_args: {'id': 'e97f8453-690a-4d27-8061-81007783d32a'} Jul 12 17:43:22.010514 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:43:22.010514 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:43:22.010514 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:43:22.010514 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:43:22.010514 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:43:22.010514 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:43:22.010514 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:43:22.010514 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:43:22.010514 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:43:22.010514 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:43:22.010514 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e97f8453-690a-4d27-8061-81007783d32a could not be found. Jul 12 17:43:22.010514 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:43:22.010514 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:43:22.010514 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:43:22.010514 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:43:22.010514 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:43:22.010514 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:43:22.010514 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:43:22.010514 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:43:22.010514 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:43:22.011882 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:43:22.011882 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:43:22.011882 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:43:22.011882 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:43:22.011882 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:43:22.011882 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:43:22.011882 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:43:22.011882 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e97f8453-690a-4d27-8061-81007783d32a could not be found. Jul 12 17:43:22.011882 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:43:22.011882 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:43:22.011882 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:43:22.011882 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:43:22.011882 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:43:22.011882 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:43:22.011882 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:43:22.011882 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:43:22.011882 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e97f8453-690a-4d27-8061-81007783d32a could not be found. Jul 12 17:43:22.011882 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:43:22.013236 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-2cbc142b-1fdc-480a-a888-a570d1d41498 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] Returning 404 to user: Instance e97f8453-690a-4d27-8061-81007783d32a could not be found. {{(pid=130058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:43:22.013236 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-2cbc142b-1fdc-480a-a888-a570d1d41498 tempest-VolumesNegativeTest-1762592972 tempest-VolumesNegativeTest-1762592972-project] 10.222.0.16 "GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a" status: 404 len: 111 microversion: 2.1 time: 0.032095 Jul 12 17:43:22.013236 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 303/618] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:21 2022] GET /compute/v2.1/servers/e97f8453-690a-4d27-8061-81007783d32a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:43:22.088913 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-88773613-afe5-44f1-a538-fcfb52578f94 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:22.097307 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-88773613-afe5-44f1-a538-fcfb52578f94 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1548 microversion: 2.1 time: 0.235932 Jul 12 17:43:22.098015 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 316/619] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:21 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1548 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:43:22.114592 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-c8ffee1a-8228-4f89-a7fe-eff115ee92fb tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:22.118084 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-c8ffee1a-8228-4f89-a7fe-eff115ee92fb tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:22.118868 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-c8ffee1a-8228-4f89-a7fe-eff115ee92fb tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Searching by: {'deleted': False, 'project_id': '80285308991b47308701fd3363bec122'} {{(pid=130058) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 17:43:22.125768 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c8ffee1a-8228-4f89-a7fe-eff115ee92fb tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:22.126216 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c8ffee1a-8228-4f89-a7fe-eff115ee92fb tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:22.127062 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c8ffee1a-8228-4f89-a7fe-eff115ee92fb tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:22.127495 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c8ffee1a-8228-4f89-a7fe-eff115ee92fb tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:22.220810 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.multi_cell_list [None req-c8ffee1a-8228-4f89-a7fe-eff115ee92fb tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130058) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 17:43:22.337807 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-c8ffee1a-8228-4f89-a7fe-eff115ee92fb tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.221041 Jul 12 17:43:22.337807 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 304/620] 10.222.0.16 () {58 vars in 1124 bytes} [Tue Jul 12 17:43:22 2022] GET /compute/v2.1/servers => generated 342 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:43:22.346778 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-680f4f37-ee60-4757-81b6-49f2463a29b9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:22.350913 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-680f4f37-ee60-4757-81b6-49f2463a29b9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:22.366287 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-680f4f37-ee60-4757-81b6-49f2463a29b9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:22.367098 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-680f4f37-ee60-4757-81b6-49f2463a29b9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:22.368739 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-680f4f37-ee60-4757-81b6-49f2463a29b9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:22.369253 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-680f4f37-ee60-4757-81b6-49f2463a29b9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:22.396143 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-8312296f-35e1-481c-9d17-c6d1f4fa9a44 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:43:22.397907 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-8312296f-35e1-481c-9d17-c6d1f4fa9a44 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:22.408977 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8312296f-35e1-481c-9d17-c6d1f4fa9a44 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:22.410525 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8312296f-35e1-481c-9d17-c6d1f4fa9a44 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:22.415989 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8312296f-35e1-481c-9d17-c6d1f4fa9a44 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:22.415989 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8312296f-35e1-481c-9d17-c6d1f4fa9a44 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:22.439903 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.objects.instance [None req-8312296f-35e1-481c-9d17-c6d1f4fa9a44 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lazy-loading 'flavor' on Instance uuid eab0c8cd-6093-440a-8e95-c58ede89a22b {{(pid=130058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:43:22.654363 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-680f4f37-ee60-4757-81b6-49f2463a29b9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:22.664167 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-680f4f37-ee60-4757-81b6-49f2463a29b9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1548 microversion: 2.1 time: 0.324939 Jul 12 17:43:22.664757 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 317/621] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:22 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1548 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:22.984618 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-8312296f-35e1-481c-9d17-c6d1f4fa9a44 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "POST /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b/action" status: 200 len: 32 microversion: 2.1 time: 0.598865 Jul 12 17:43:23.002490 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-0c192e15-5aa3-48a5-85c6-8ae53abaa754 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:23.004249 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-0c192e15-5aa3-48a5-85c6-8ae53abaa754 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:23.004571 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 305/622] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jul 12 17:43:22 2022] POST /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b/action => generated 32 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 12 17:43:23.033637 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0c192e15-5aa3-48a5-85c6-8ae53abaa754 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:23.034359 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0c192e15-5aa3-48a5-85c6-8ae53abaa754 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:23.036307 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0c192e15-5aa3-48a5-85c6-8ae53abaa754 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:23.037038 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0c192e15-5aa3-48a5-85c6-8ae53abaa754 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:23.262867 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-0c192e15-5aa3-48a5-85c6-8ae53abaa754 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:23.286798 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-0c192e15-5aa3-48a5-85c6-8ae53abaa754 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1732 microversion: 2.1 time: 0.290545 Jul 12 17:43:23.288898 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 318/623] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:22 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1732 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:43:23.507167 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-85a5b23f-e7e6-44b4-863b-1c8ef8e8a853 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1524377213", "imageRef": "cb077f42-97cd-41cf-8758-764c562534f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "788020f8-05a4-4c17-a8ec-9f084f5359c6"}], "security_groups": [{"name": "tempest-securitygroup--865209267"}], "key_name": "tempest-keypair-1691053878", "user_data": "}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:43:23.727498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.network.neutron [None req-85a5b23f-e7e6-44b4-863b-1c8ef8e8a853 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] validate_networks() for [('788020f8-05a4-4c17-a8ec-9f084f5359c6', None, None, None, None, None)] {{(pid=130058) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:43:24.306101 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-90fcb28d-65ee-43d3-b47b-6ff86f418922 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:24.306759 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-90fcb28d-65ee-43d3-b47b-6ff86f418922 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:24.317595 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-90fcb28d-65ee-43d3-b47b-6ff86f418922 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:24.318741 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-90fcb28d-65ee-43d3-b47b-6ff86f418922 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:24.320196 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-90fcb28d-65ee-43d3-b47b-6ff86f418922 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:24.321009 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-90fcb28d-65ee-43d3-b47b-6ff86f418922 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:24.339914 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-85a5b23f-e7e6-44b4-863b-1c8ef8e8a853 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Flavor limits 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:43:24.341018 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-85a5b23f-e7e6-44b4-863b-1c8ef8e8a853 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Image limits 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:43:24.341695 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-85a5b23f-e7e6-44b4-863b-1c8ef8e8a853 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Flavor pref 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:43:24.342583 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-85a5b23f-e7e6-44b4-863b-1c8ef8e8a853 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Image pref 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:43:24.343159 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-85a5b23f-e7e6-44b4-863b-1c8ef8e8a853 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:43:24.358733 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-85a5b23f-e7e6-44b4-863b-1c8ef8e8a853 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:24.359384 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-85a5b23f-e7e6-44b4-863b-1c8ef8e8a853 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:24.360503 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-85a5b23f-e7e6-44b4-863b-1c8ef8e8a853 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:24.361448 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-85a5b23f-e7e6-44b4-863b-1c8ef8e8a853 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:24.398347 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-85a5b23f-e7e6-44b4-863b-1c8ef8e8a853 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Getting quotas for project 84b840eaa59d4f73ac68926437f03d82. Resources: {'cores', 'instances', 'ram'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:43:24.408725 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-85a5b23f-e7e6-44b4-863b-1c8ef8e8a853 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Getting quotas for user c8441a4a72154ee3bbb95af66abf2ffd and project 84b840eaa59d4f73ac68926437f03d82. Resources: {'cores', 'instances', 'ram'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:43:24.430938 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-85a5b23f-e7e6-44b4-863b-1c8ef8e8a853 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Going to run 1 instances... {{(pid=130058) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:43:24.433857 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-85a5b23f-e7e6-44b4-863b-1c8ef8e8a853 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb077f42-97cd-41cf-8758-764c562534f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:43:24.497814 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-90fcb28d-65ee-43d3-b47b-6ff86f418922 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:24.507693 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-90fcb28d-65ee-43d3-b47b-6ff86f418922 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1732 microversion: 2.1 time: 0.205850 Jul 12 17:43:24.508288 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 319/624] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:24 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1732 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:43:24.588719 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-85a5b23f-e7e6-44b4-863b-1c8ef8e8a853 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.086735 Jul 12 17:43:24.597980 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 306/625] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 12 17:43:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 1094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:43:24.605218 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-07259708-3777-4508-998e-4bac7fea7dae tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:24.606395 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-07259708-3777-4508-998e-4bac7fea7dae tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:24.683593 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-07259708-3777-4508-998e-4bac7fea7dae tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:24.696336 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-07259708-3777-4508-998e-4bac7fea7dae tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f" status: 200 len: 1242 microversion: 2.1 time: 0.095106 Jul 12 17:43:24.697343 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 320/626] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:24 2022] GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f => generated 1242 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:43:24.864849 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-cfbaeecd-da51-46f4-a888-74738d810c79 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "486111e8-7884-4bda-b39f-dbf471baa84a"}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:43:24.866010 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-cfbaeecd-da51-46f4-a888-74738d810c79 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:24.872972 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cfbaeecd-da51-46f4-a888-74738d810c79 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:24.876352 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cfbaeecd-da51-46f4-a888-74738d810c79 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:24.876352 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cfbaeecd-da51-46f4-a888-74738d810c79 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:24.876352 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cfbaeecd-da51-46f4-a888-74738d810c79 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:25.541569 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-4ea7f7df-67fb-4b4e-a6e8-ca1cb877574c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:25.543645 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-4ea7f7df-67fb-4b4e-a6e8-ca1cb877574c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:25.558659 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4ea7f7df-67fb-4b4e-a6e8-ca1cb877574c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:25.558659 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4ea7f7df-67fb-4b4e-a6e8-ca1cb877574c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:25.559194 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4ea7f7df-67fb-4b4e-a6e8-ca1cb877574c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:25.560169 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4ea7f7df-67fb-4b4e-a6e8-ca1cb877574c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:25.780266 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-4ea7f7df-67fb-4b4e-a6e8-ca1cb877574c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:25.789462 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-4ea7f7df-67fb-4b4e-a6e8-ca1cb877574c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1732 microversion: 2.1 time: 0.259380 Jul 12 17:43:25.790421 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 321/627] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:25 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1732 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:25.798165 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-fe9e852e-ac32-4b8a-b4aa-36ec9211c275 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:25.799093 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-fe9e852e-ac32-4b8a-b4aa-36ec9211c275 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:25.807390 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fe9e852e-ac32-4b8a-b4aa-36ec9211c275 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:25.808121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fe9e852e-ac32-4b8a-b4aa-36ec9211c275 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:25.808955 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fe9e852e-ac32-4b8a-b4aa-36ec9211c275 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:25.809398 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fe9e852e-ac32-4b8a-b4aa-36ec9211c275 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:25.827248 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-cfbaeecd-da51-46f4-a888-74738d810c79 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "POST /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.966010 Jul 12 17:43:25.828260 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 307/628] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jul 12 17:43:24 2022] POST /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72/os-volume_attachments => generated 194 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:43:25.916862 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-fe9e852e-ac32-4b8a-b4aa-36ec9211c275 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:25.928213 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-fe9e852e-ac32-4b8a-b4aa-36ec9211c275 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f" status: 200 len: 1246 microversion: 2.1 time: 0.134361 Jul 12 17:43:25.928213 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 322/629] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:25 2022] GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f => generated 1246 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:26.815957 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-5c2e203a-7bba-485b-b952-b38cb4f41107 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:26.819161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-5c2e203a-7bba-485b-b952-b38cb4f41107 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:26.830831 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5c2e203a-7bba-485b-b952-b38cb4f41107 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:26.831703 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5c2e203a-7bba-485b-b952-b38cb4f41107 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:26.833826 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5c2e203a-7bba-485b-b952-b38cb4f41107 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:26.834703 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5c2e203a-7bba-485b-b952-b38cb4f41107 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:26.945788 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-98ee0a5e-fdb1-4716-88e6-4da3c2ca2eb1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:26.946723 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-98ee0a5e-fdb1-4716-88e6-4da3c2ca2eb1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:26.954031 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-98ee0a5e-fdb1-4716-88e6-4da3c2ca2eb1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:26.958347 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-98ee0a5e-fdb1-4716-88e6-4da3c2ca2eb1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:26.958347 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-98ee0a5e-fdb1-4716-88e6-4da3c2ca2eb1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:26.958347 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-98ee0a5e-fdb1-4716-88e6-4da3c2ca2eb1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:27.000865 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-5c2e203a-7bba-485b-b952-b38cb4f41107 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:27.009884 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-5c2e203a-7bba-485b-b952-b38cb4f41107 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1732 microversion: 2.1 time: 0.204042 Jul 12 17:43:27.011249 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 308/630] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:26 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1732 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:27.037081 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-98ee0a5e-fdb1-4716-88e6-4da3c2ca2eb1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:27.047909 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-98ee0a5e-fdb1-4716-88e6-4da3c2ca2eb1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f" status: 200 len: 1294 microversion: 2.1 time: 0.107350 Jul 12 17:43:27.049014 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 323/631] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:26 2022] GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f => generated 1294 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:43:28.032869 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-3c3080e6-bb9a-4ba4-93e2-4e60b5a11c08 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:28.034145 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-3c3080e6-bb9a-4ba4-93e2-4e60b5a11c08 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:28.046701 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3c3080e6-bb9a-4ba4-93e2-4e60b5a11c08 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:28.047502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3c3080e6-bb9a-4ba4-93e2-4e60b5a11c08 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:28.048949 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3c3080e6-bb9a-4ba4-93e2-4e60b5a11c08 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:28.049751 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3c3080e6-bb9a-4ba4-93e2-4e60b5a11c08 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:28.076858 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-e3b9b55a-90be-4a30-b90b-63768c5e81f0 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:28.077845 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-e3b9b55a-90be-4a30-b90b-63768c5e81f0 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:28.086944 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e3b9b55a-90be-4a30-b90b-63768c5e81f0 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:28.087550 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e3b9b55a-90be-4a30-b90b-63768c5e81f0 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:28.088670 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e3b9b55a-90be-4a30-b90b-63768c5e81f0 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:28.089721 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e3b9b55a-90be-4a30-b90b-63768c5e81f0 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:28.191218 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-e3b9b55a-90be-4a30-b90b-63768c5e81f0 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:28.206479 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-e3b9b55a-90be-4a30-b90b-63768c5e81f0 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f" status: 200 len: 1300 microversion: 2.1 time: 0.133962 Jul 12 17:43:28.208139 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 324/632] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:28 2022] GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f => generated 1300 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:43:28.444197 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-3c3080e6-bb9a-4ba4-93e2-4e60b5a11c08 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:28.452486 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-3c3080e6-bb9a-4ba4-93e2-4e60b5a11c08 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1732 microversion: 2.1 time: 0.427488 Jul 12 17:43:28.453082 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 309/633] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:28 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1732 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:29.227456 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-d1697a15-1e45-4f4f-99e3-b28be9dd552f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:29.234767 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-d1697a15-1e45-4f4f-99e3-b28be9dd552f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:29.244282 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d1697a15-1e45-4f4f-99e3-b28be9dd552f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:29.244817 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d1697a15-1e45-4f4f-99e3-b28be9dd552f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:29.245518 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d1697a15-1e45-4f4f-99e3-b28be9dd552f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:29.246052 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d1697a15-1e45-4f4f-99e3-b28be9dd552f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:29.414885 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-d1697a15-1e45-4f4f-99e3-b28be9dd552f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:29.430919 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-d1697a15-1e45-4f4f-99e3-b28be9dd552f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f" status: 200 len: 1367 microversion: 2.1 time: 0.208662 Jul 12 17:43:29.432641 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 325/634] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:29 2022] GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:29.473450 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-74e7b1a5-7f7f-432d-861d-492ec1bdd0b8 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:29.473450 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-74e7b1a5-7f7f-432d-861d-492ec1bdd0b8 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:29.481152 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-74e7b1a5-7f7f-432d-861d-492ec1bdd0b8 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:29.482185 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-74e7b1a5-7f7f-432d-861d-492ec1bdd0b8 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:29.483328 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-74e7b1a5-7f7f-432d-861d-492ec1bdd0b8 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:29.484347 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-74e7b1a5-7f7f-432d-861d-492ec1bdd0b8 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:29.790819 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-74e7b1a5-7f7f-432d-861d-492ec1bdd0b8 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:29.807740 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-74e7b1a5-7f7f-432d-861d-492ec1bdd0b8 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1732 microversion: 2.1 time: 0.340816 Jul 12 17:43:29.809872 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 310/635] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:29 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1732 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:29.979319 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-cadd82bb-1cf5-4141-9592-c3cda64b2ccb req-ffd6a26f-521c-4888-ae6c-4cd9d26aabc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22b53cb5-97e1-40c6-bffe-ca1132409e2f", "tag": "22a38997-dd58-4cc9-9178-17fe3af61539"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:43:29.993716 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-cadd82bb-1cf5-4141-9592-c3cda64b2ccb req-ffd6a26f-521c-4888-ae6c-4cd9d26aabc3 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:30.005248 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-cadd82bb-1cf5-4141-9592-c3cda64b2ccb req-ffd6a26f-521c-4888-ae6c-4cd9d26aabc3 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:30.010288 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-cadd82bb-1cf5-4141-9592-c3cda64b2ccb req-ffd6a26f-521c-4888-ae6c-4cd9d26aabc3 service nova] Creating event network-changed:22a38997-dd58-4cc9-9178-17fe3af61539 for instance 22b53cb5-97e1-40c6-bffe-ca1132409e2f on hv-cinder-84875 Jul 12 17:43:30.016476 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-cadd82bb-1cf5-4141-9592-c3cda64b2ccb req-ffd6a26f-521c-4888-ae6c-4cd9d26aabc3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044051 Jul 12 17:43:30.017374 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 326/636] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:43:30.453356 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-8681ea6c-8e1e-4552-aa54-2761bfc596af tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:30.454308 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-8681ea6c-8e1e-4552-aa54-2761bfc596af tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:30.462588 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8681ea6c-8e1e-4552-aa54-2761bfc596af tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:30.463156 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8681ea6c-8e1e-4552-aa54-2761bfc596af tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:30.464067 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8681ea6c-8e1e-4552-aa54-2761bfc596af tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:30.464584 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8681ea6c-8e1e-4552-aa54-2761bfc596af tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:30.725902 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-8681ea6c-8e1e-4552-aa54-2761bfc596af tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:30.734109 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-8681ea6c-8e1e-4552-aa54-2761bfc596af tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f" status: 200 len: 1367 microversion: 2.1 time: 0.286823 Jul 12 17:43:30.734748 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 311/637] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:30 2022] GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f => generated 1367 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:30.837688 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-9f7674aa-c357-4ef1-9633-433a619aa652 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:30.838365 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-9f7674aa-c357-4ef1-9633-433a619aa652 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:30.845304 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9f7674aa-c357-4ef1-9633-433a619aa652 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:30.845750 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9f7674aa-c357-4ef1-9633-433a619aa652 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:30.846602 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9f7674aa-c357-4ef1-9633-433a619aa652 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:30.847044 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9f7674aa-c357-4ef1-9633-433a619aa652 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:31.015913 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-9f7674aa-c357-4ef1-9633-433a619aa652 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:31.030457 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-9f7674aa-c357-4ef1-9633-433a619aa652 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1732 microversion: 2.1 time: 0.197731 Jul 12 17:43:31.031521 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 327/638] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:30 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1732 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:43:31.752458 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-bd0105ad-f26f-4967-be1a-a760405e3e40 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:31.753510 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-bd0105ad-f26f-4967-be1a-a760405e3e40 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:31.761538 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bd0105ad-f26f-4967-be1a-a760405e3e40 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:31.761992 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bd0105ad-f26f-4967-be1a-a760405e3e40 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:31.762832 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bd0105ad-f26f-4967-be1a-a760405e3e40 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:31.763358 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bd0105ad-f26f-4967-be1a-a760405e3e40 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:31.911250 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-bd0105ad-f26f-4967-be1a-a760405e3e40 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:31.919035 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-bd0105ad-f26f-4967-be1a-a760405e3e40 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f" status: 200 len: 1367 microversion: 2.1 time: 0.170790 Jul 12 17:43:31.919643 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 312/639] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:31 2022] GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:43:32.049073 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-29e97f86-f04c-4b30-a692-5180fbacb36b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:32.049682 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-29e97f86-f04c-4b30-a692-5180fbacb36b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:32.057040 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-29e97f86-f04c-4b30-a692-5180fbacb36b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:32.057491 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-29e97f86-f04c-4b30-a692-5180fbacb36b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:32.058270 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-29e97f86-f04c-4b30-a692-5180fbacb36b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:32.058747 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-29e97f86-f04c-4b30-a692-5180fbacb36b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:32.203958 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-29e97f86-f04c-4b30-a692-5180fbacb36b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:32.213348 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-29e97f86-f04c-4b30-a692-5180fbacb36b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1732 microversion: 2.1 time: 0.168129 Jul 12 17:43:32.213932 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 328/640] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:32 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:32.944282 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-cbf348ea-4110-4469-821b-7a80d3130b42 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:32.944851 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-cbf348ea-4110-4469-821b-7a80d3130b42 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:32.951785 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cbf348ea-4110-4469-821b-7a80d3130b42 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:32.952630 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cbf348ea-4110-4469-821b-7a80d3130b42 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:32.953035 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cbf348ea-4110-4469-821b-7a80d3130b42 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:32.953490 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cbf348ea-4110-4469-821b-7a80d3130b42 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:33.112090 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-cbf348ea-4110-4469-821b-7a80d3130b42 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:33.120399 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-cbf348ea-4110-4469-821b-7a80d3130b42 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f" status: 200 len: 1367 microversion: 2.1 time: 0.180973 Jul 12 17:43:33.124321 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 313/641] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:32 2022] GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:33.231384 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-43c3d6d4-4b3b-41b0-a242-46f58f3ba540 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:33.232150 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-43c3d6d4-4b3b-41b0-a242-46f58f3ba540 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:33.240111 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-43c3d6d4-4b3b-41b0-a242-46f58f3ba540 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:33.240780 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-43c3d6d4-4b3b-41b0-a242-46f58f3ba540 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:33.241792 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-43c3d6d4-4b3b-41b0-a242-46f58f3ba540 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:33.242288 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-43c3d6d4-4b3b-41b0-a242-46f58f3ba540 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:33.396859 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-43c3d6d4-4b3b-41b0-a242-46f58f3ba540 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:33.405413 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-43c3d6d4-4b3b-41b0-a242-46f58f3ba540 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1732 microversion: 2.1 time: 0.178749 Jul 12 17:43:33.406001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 329/642] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:33 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1732 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:43:34.139660 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-5cfa8b4f-39cc-4a88-bf0d-faca8d265e4f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:34.140478 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-5cfa8b4f-39cc-4a88-bf0d-faca8d265e4f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:34.147938 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5cfa8b4f-39cc-4a88-bf0d-faca8d265e4f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:34.148368 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5cfa8b4f-39cc-4a88-bf0d-faca8d265e4f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:34.168742 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5cfa8b4f-39cc-4a88-bf0d-faca8d265e4f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:34.168742 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5cfa8b4f-39cc-4a88-bf0d-faca8d265e4f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:34.329967 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-5cfa8b4f-39cc-4a88-bf0d-faca8d265e4f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:34.339143 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-5cfa8b4f-39cc-4a88-bf0d-faca8d265e4f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f" status: 200 len: 1367 microversion: 2.1 time: 0.203502 Jul 12 17:43:34.339943 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 314/643] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:34 2022] GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:34.429305 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-1682e671-98b1-472f-96ab-f8bfeb62cb66 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:34.429914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-1682e671-98b1-472f-96ab-f8bfeb62cb66 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:34.437261 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1682e671-98b1-472f-96ab-f8bfeb62cb66 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:34.437712 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1682e671-98b1-472f-96ab-f8bfeb62cb66 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:34.438610 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1682e671-98b1-472f-96ab-f8bfeb62cb66 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:34.439054 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1682e671-98b1-472f-96ab-f8bfeb62cb66 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:34.600399 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-1682e671-98b1-472f-96ab-f8bfeb62cb66 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:34.614368 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-1682e671-98b1-472f-96ab-f8bfeb62cb66 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1732 microversion: 2.1 time: 0.189090 Jul 12 17:43:34.615395 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 330/644] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:34 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1732 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:34.785693 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-0b7c430c-f159-4933-acf6-b93f703c214d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:34.786087 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-0b7c430c-f159-4933-acf6-b93f703c214d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:34.788227 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell0:SELECT=4 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:43:34.788928 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell0:SELECT=10 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:43:34.794194 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0b7c430c-f159-4933-acf6-b93f703c214d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:34.794690 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0b7c430c-f159-4933-acf6-b93f703c214d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:34.795511 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0b7c430c-f159-4933-acf6-b93f703c214d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:34.795955 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0b7c430c-f159-4933-acf6-b93f703c214d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:34.814995 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:43:34.959067 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0b7c430c-f159-4933-acf6-b93f703c214d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:34.968571 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-0b7c430c-f159-4933-acf6-b93f703c214d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1594 microversion: 2.1 time: 0.186929 Jul 12 17:43:34.969284 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 315/645] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:34 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1594 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:35.364856 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-fed5b5e0-2576-4020-83c9-41b1e210c4b0 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:35.365474 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-fed5b5e0-2576-4020-83c9-41b1e210c4b0 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:35.367597 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell0:SELECT=2 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:43:35.372996 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fed5b5e0-2576-4020-83c9-41b1e210c4b0 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:35.378418 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fed5b5e0-2576-4020-83c9-41b1e210c4b0 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:35.378418 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fed5b5e0-2576-4020-83c9-41b1e210c4b0 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:35.378418 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fed5b5e0-2576-4020-83c9-41b1e210c4b0 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:35.395580 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=100 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:43:35.634555 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-c8fb0a88-6d42-4c59-b171-e4e7e1e20a22 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:35.635296 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-c8fb0a88-6d42-4c59-b171-e4e7e1e20a22 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:35.642672 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c8fb0a88-6d42-4c59-b171-e4e7e1e20a22 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:35.642971 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c8fb0a88-6d42-4c59-b171-e4e7e1e20a22 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:35.643733 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c8fb0a88-6d42-4c59-b171-e4e7e1e20a22 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:35.644220 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c8fb0a88-6d42-4c59-b171-e4e7e1e20a22 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:35.677227 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-fed5b5e0-2576-4020-83c9-41b1e210c4b0 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:35.698067 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-fed5b5e0-2576-4020-83c9-41b1e210c4b0 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f" status: 200 len: 1367 microversion: 2.1 time: 0.337941 Jul 12 17:43:35.698709 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 331/646] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:35 2022] GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f => generated 1367 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:35.811343 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-c8fb0a88-6d42-4c59-b171-e4e7e1e20a22 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:35.827388 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-c8fb0a88-6d42-4c59-b171-e4e7e1e20a22 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1732 microversion: 2.1 time: 0.196572 Jul 12 17:43:35.828384 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 316/647] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:35 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1732 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:36.657602 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-97f7bbc5-acdb-49ec-90d6-3294547c20cd req-50ce103a-9871-4f4e-a276-41256829cf3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b53cb5-97e1-40c6-bffe-ca1132409e2f", "name": "network-vif-plugged", "status": "completed", "tag": "22a38997-dd58-4cc9-9178-17fe3af61539"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:43:36.667435 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-97f7bbc5-acdb-49ec-90d6-3294547c20cd req-50ce103a-9871-4f4e-a276-41256829cf3a service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:36.667886 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-97f7bbc5-acdb-49ec-90d6-3294547c20cd req-50ce103a-9871-4f4e-a276-41256829cf3a service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:36.681249 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-97f7bbc5-acdb-49ec-90d6-3294547c20cd req-50ce103a-9871-4f4e-a276-41256829cf3a service nova] Creating event network-vif-plugged:22a38997-dd58-4cc9-9178-17fe3af61539 for instance 22b53cb5-97e1-40c6-bffe-ca1132409e2f on hv-cinder-84875 Jul 12 17:43:36.687119 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-97f7bbc5-acdb-49ec-90d6-3294547c20cd req-50ce103a-9871-4f4e-a276-41256829cf3a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033290 Jul 12 17:43:36.687747 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 332/648] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:43:36.715209 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-6d3b23cd-0c6f-4ab5-a099-9c691260fb24 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:36.715821 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-6d3b23cd-0c6f-4ab5-a099-9c691260fb24 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:36.726078 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6d3b23cd-0c6f-4ab5-a099-9c691260fb24 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:36.727650 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6d3b23cd-0c6f-4ab5-a099-9c691260fb24 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:36.727650 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6d3b23cd-0c6f-4ab5-a099-9c691260fb24 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:36.727934 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6d3b23cd-0c6f-4ab5-a099-9c691260fb24 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:36.849642 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-57053659-f77e-47c6-9e29-a7f39b098ac5 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:36.850422 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-57053659-f77e-47c6-9e29-a7f39b098ac5 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:36.857999 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-57053659-f77e-47c6-9e29-a7f39b098ac5 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:36.859667 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-57053659-f77e-47c6-9e29-a7f39b098ac5 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:36.859667 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-57053659-f77e-47c6-9e29-a7f39b098ac5 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:36.859871 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-57053659-f77e-47c6-9e29-a7f39b098ac5 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:36.942127 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-6d3b23cd-0c6f-4ab5-a099-9c691260fb24 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:36.951319 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-6d3b23cd-0c6f-4ab5-a099-9c691260fb24 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f" status: 200 len: 1367 microversion: 2.1 time: 0.239899 Jul 12 17:43:36.952385 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 317/649] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:36 2022] GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:37.115670 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-57053659-f77e-47c6-9e29-a7f39b098ac5 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:37.124311 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-57053659-f77e-47c6-9e29-a7f39b098ac5 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1732 microversion: 2.1 time: 0.280320 Jul 12 17:43:37.124912 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 333/650] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:36 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1732 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:43:37.976578 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-74044925-2df0-4a4c-9606-1712478e95a2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:37.977413 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-74044925-2df0-4a4c-9606-1712478e95a2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:37.984683 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-74044925-2df0-4a4c-9606-1712478e95a2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:37.985237 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-74044925-2df0-4a4c-9606-1712478e95a2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:37.986098 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-74044925-2df0-4a4c-9606-1712478e95a2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:37.986729 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-74044925-2df0-4a4c-9606-1712478e95a2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:38.085711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-2b6433bf-75b5-439c-ac82-c1bee322c3f6 req-938c0d9f-9b1d-4e55-a1ff-2402ddc63cda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d57de92-32ca-4ff9-a5ea-00d7e83bbf72", "tag": "c4901ed1-f277-462c-b8b5-c19838c33e73"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:43:38.095069 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-2b6433bf-75b5-439c-ac82-c1bee322c3f6 req-938c0d9f-9b1d-4e55-a1ff-2402ddc63cda service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:38.095514 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-2b6433bf-75b5-439c-ac82-c1bee322c3f6 req-938c0d9f-9b1d-4e55-a1ff-2402ddc63cda service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:38.111916 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-2b6433bf-75b5-439c-ac82-c1bee322c3f6 req-938c0d9f-9b1d-4e55-a1ff-2402ddc63cda service nova] Creating event network-changed:c4901ed1-f277-462c-b8b5-c19838c33e73 for instance 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 on hv-cinder-84875 Jul 12 17:43:38.118607 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-2b6433bf-75b5-439c-ac82-c1bee322c3f6 req-938c0d9f-9b1d-4e55-a1ff-2402ddc63cda service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038052 Jul 12 17:43:38.120239 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 334/651] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:43:38.143551 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-78f1ec4e-4af2-4d19-bd17-ae5b948671c2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:38.145396 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-78f1ec4e-4af2-4d19-bd17-ae5b948671c2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:38.152740 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-78f1ec4e-4af2-4d19-bd17-ae5b948671c2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:38.153363 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-78f1ec4e-4af2-4d19-bd17-ae5b948671c2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:38.154256 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-78f1ec4e-4af2-4d19-bd17-ae5b948671c2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:38.154850 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-78f1ec4e-4af2-4d19-bd17-ae5b948671c2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:38.231353 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-74044925-2df0-4a4c-9606-1712478e95a2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:38.251750 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-74044925-2df0-4a4c-9606-1712478e95a2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f" status: 200 len: 1367 microversion: 2.1 time: 0.279652 Jul 12 17:43:38.257324 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 318/652] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:37 2022] GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f => generated 1367 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:38.374193 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-78f1ec4e-4af2-4d19-bd17-ae5b948671c2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:38.388253 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-78f1ec4e-4af2-4d19-bd17-ae5b948671c2 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1732 microversion: 2.1 time: 0.249938 Jul 12 17:43:38.389849 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 335/653] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:38 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1732 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:43:39.269936 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-aa1cce29-07e2-432b-8053-5f2e42aadd26 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:39.270698 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-aa1cce29-07e2-432b-8053-5f2e42aadd26 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:39.273046 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:43:39.279083 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-aa1cce29-07e2-432b-8053-5f2e42aadd26 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:39.279547 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-aa1cce29-07e2-432b-8053-5f2e42aadd26 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:39.280352 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-aa1cce29-07e2-432b-8053-5f2e42aadd26 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:39.280883 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-aa1cce29-07e2-432b-8053-5f2e42aadd26 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:39.415610 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-39490a7e-1e5c-4ad3-8e16-faeee3dd761f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:39.428989 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-39490a7e-1e5c-4ad3-8e16-faeee3dd761f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:39.430733 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-39490a7e-1e5c-4ad3-8e16-faeee3dd761f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:39.431821 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-39490a7e-1e5c-4ad3-8e16-faeee3dd761f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:39.433218 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-39490a7e-1e5c-4ad3-8e16-faeee3dd761f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:39.434001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-39490a7e-1e5c-4ad3-8e16-faeee3dd761f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:39.670406 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-aa1cce29-07e2-432b-8053-5f2e42aadd26 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:39.690465 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-aa1cce29-07e2-432b-8053-5f2e42aadd26 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f" status: 200 len: 1555 microversion: 2.1 time: 0.424033 Jul 12 17:43:39.691624 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 319/654] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:39 2022] GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f => generated 1555 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:39.713171 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-8e28bf4d-501b-4afd-9de6-32bbdb8ac510 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:39.713796 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-8e28bf4d-501b-4afd-9de6-32bbdb8ac510 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:39.725195 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8e28bf4d-501b-4afd-9de6-32bbdb8ac510 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:39.726013 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8e28bf4d-501b-4afd-9de6-32bbdb8ac510 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:39.727454 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8e28bf4d-501b-4afd-9de6-32bbdb8ac510 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:39.728321 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8e28bf4d-501b-4afd-9de6-32bbdb8ac510 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:39.735147 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-39490a7e-1e5c-4ad3-8e16-faeee3dd761f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:39.757409 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-39490a7e-1e5c-4ad3-8e16-faeee3dd761f tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1732 microversion: 2.1 time: 0.349312 Jul 12 17:43:39.758023 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 336/655] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:39 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1732 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:39.830672 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-8e28bf4d-501b-4afd-9de6-32bbdb8ac510 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.123482 Jul 12 17:43:39.831283 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 320/656] 10.222.0.16 () {58 vars in 1274 bytes} [Tue Jul 12 17:43:39 2022] GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:43:40.778488 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-78b60cc1-5ecb-46ab-ab3c-27544046b13c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:40.779814 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-78b60cc1-5ecb-46ab-ab3c-27544046b13c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:40.787116 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-78b60cc1-5ecb-46ab-ab3c-27544046b13c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:40.787559 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-78b60cc1-5ecb-46ab-ab3c-27544046b13c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:40.788632 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-78b60cc1-5ecb-46ab-ab3c-27544046b13c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:40.789084 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-78b60cc1-5ecb-46ab-ab3c-27544046b13c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:40.977018 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-78b60cc1-5ecb-46ab-ab3c-27544046b13c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:40.986688 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-78b60cc1-5ecb-46ab-ab3c-27544046b13c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1732 microversion: 2.1 time: 0.212431 Jul 12 17:43:40.987290 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 337/657] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:40 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1732 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:41.482789 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-b0545f02-8ddf-4e72-a849-87f2563e87f6 req-22d933a4-9756-46bf-a912-5797b9471353 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22b53cb5-97e1-40c6-bffe-ca1132409e2f", "tag": "22a38997-dd58-4cc9-9178-17fe3af61539"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:43:41.493790 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-b0545f02-8ddf-4e72-a849-87f2563e87f6 req-22d933a4-9756-46bf-a912-5797b9471353 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:41.494316 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-b0545f02-8ddf-4e72-a849-87f2563e87f6 req-22d933a4-9756-46bf-a912-5797b9471353 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:41.509354 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-b0545f02-8ddf-4e72-a849-87f2563e87f6 req-22d933a4-9756-46bf-a912-5797b9471353 service nova] Creating event network-changed:22a38997-dd58-4cc9-9178-17fe3af61539 for instance 22b53cb5-97e1-40c6-bffe-ca1132409e2f on hv-cinder-84875 Jul 12 17:43:41.515699 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-b0545f02-8ddf-4e72-a849-87f2563e87f6 req-22d933a4-9756-46bf-a912-5797b9471353 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037408 Jul 12 17:43:41.516083 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 321/658] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:43:41.992580 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-6f1f1d7f-42f1-4f86-8d6b-cec47941f696 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-602816"}} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:43:41.993267 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-6f1f1d7f-42f1-4f86-8d6b-cec47941f696 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:41.999999 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6f1f1d7f-42f1-4f86-8d6b-cec47941f696 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:42.000788 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6f1f1d7f-42f1-4f86-8d6b-cec47941f696 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:42.001690 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6f1f1d7f-42f1-4f86-8d6b-cec47941f696 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:42.002239 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6f1f1d7f-42f1-4f86-8d6b-cec47941f696 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:42.007006 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-9c84d027-09ae-4147-b9ba-e13e5b017e7b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:42.007772 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-9c84d027-09ae-4147-b9ba-e13e5b017e7b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:42.014699 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9c84d027-09ae-4147-b9ba-e13e5b017e7b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:42.015454 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9c84d027-09ae-4147-b9ba-e13e5b017e7b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:42.016584 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9c84d027-09ae-4147-b9ba-e13e5b017e7b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:42.017353 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9c84d027-09ae-4147-b9ba-e13e5b017e7b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:42.202524 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-9c84d027-09ae-4147-b9ba-e13e5b017e7b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:42.203895 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.network.security_group_api [None req-6f1f1d7f-42f1-4f86-8d6b-cec47941f696 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Adding security group be217aa0-f3cc-4920-b202-4b15237a815b to port c4901ed1-f277-462c-b8b5-c19838c33e73 Jul 12 17:43:42.226843 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-9c84d027-09ae-4147-b9ba-e13e5b017e7b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1732 microversion: 2.1 time: 0.224993 Jul 12 17:43:42.227935 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 322/659] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:42 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1732 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:42.805539 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-6f1f1d7f-42f1-4f86-8d6b-cec47941f696 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "POST /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72/action" status: 202 len: 0 microversion: 2.1 time: 0.818863 Jul 12 17:43:42.807825 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 338/660] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jul 12 17:43:41 2022] POST /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72/action => generated 0 bytes in 822 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:43:42.814889 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-e53338de-6acd-477c-8507-036eb094de63 req-11850670-440d-4bf9-8a9c-75fd328662c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d57de92-32ca-4ff9-a5ea-00d7e83bbf72", "tag": "c4901ed1-f277-462c-b8b5-c19838c33e73"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:43:42.829703 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-15b34401-fa27-4c84-b782-b37ed11143ba tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:42.830815 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-15b34401-fa27-4c84-b782-b37ed11143ba tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:42.845579 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-e53338de-6acd-477c-8507-036eb094de63 req-11850670-440d-4bf9-8a9c-75fd328662c4 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:42.846072 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-e53338de-6acd-477c-8507-036eb094de63 req-11850670-440d-4bf9-8a9c-75fd328662c4 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:42.851762 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-15b34401-fa27-4c84-b782-b37ed11143ba tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:42.857796 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-15b34401-fa27-4c84-b782-b37ed11143ba tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:42.861022 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-15b34401-fa27-4c84-b782-b37ed11143ba tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:42.861919 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-15b34401-fa27-4c84-b782-b37ed11143ba tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:42.893417 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-e53338de-6acd-477c-8507-036eb094de63 req-11850670-440d-4bf9-8a9c-75fd328662c4 service nova] Creating event network-changed:c4901ed1-f277-462c-b8b5-c19838c33e73 for instance 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 on hv-cinder-84875 Jul 12 17:43:42.912338 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-e53338de-6acd-477c-8507-036eb094de63 req-11850670-440d-4bf9-8a9c-75fd328662c4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101799 Jul 12 17:43:42.922157 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 323/661] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:43:43.216642 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-15b34401-fa27-4c84-b782-b37ed11143ba tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:43.237581 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-15b34401-fa27-4c84-b782-b37ed11143ba tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1756 microversion: 2.1 time: 0.412309 Jul 12 17:43:43.238345 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 339/662] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:42 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1756 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:43.268010 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b88b7b2c-f41b-4750-a07b-5a24907d0269 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:43.268010 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-b88b7b2c-f41b-4750-a07b-5a24907d0269 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:43.278298 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b88b7b2c-f41b-4750-a07b-5a24907d0269 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:43.283386 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b88b7b2c-f41b-4750-a07b-5a24907d0269 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:43.286321 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b88b7b2c-f41b-4750-a07b-5a24907d0269 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:43.288447 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b88b7b2c-f41b-4750-a07b-5a24907d0269 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:43.533189 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-b88b7b2c-f41b-4750-a07b-5a24907d0269 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:43.544576 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-b88b7b2c-f41b-4750-a07b-5a24907d0269 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1712 microversion: 2.1 time: 0.294678 Jul 12 17:43:43.545455 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 324/663] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:43 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1712 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:43.687847 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-35b3b9c7-9a2f-4773-93c3-3d5c3fafb64d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:43.688677 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-35b3b9c7-9a2f-4773-93c3-3d5c3fafb64d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:43.698396 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-35b3b9c7-9a2f-4773-93c3-3d5c3fafb64d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:43.699311 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-35b3b9c7-9a2f-4773-93c3-3d5c3fafb64d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:43.700280 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-35b3b9c7-9a2f-4773-93c3-3d5c3fafb64d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:43.700730 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-35b3b9c7-9a2f-4773-93c3-3d5c3fafb64d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:43.822756 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-35b3b9c7-9a2f-4773-93c3-3d5c3fafb64d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] HTTP exception thrown: Cannot 'detach_volume' instance eab0c8cd-6093-440a-8e95-c58ede89a22b while it is in vm_state rescued Jul 12 17:43:43.824854 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-35b3b9c7-9a2f-4773-93c3-3d5c3fafb64d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Request method failure captured: Jul 12 17:43:43.824854 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: DELETE /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b/os-volume_attachments/14fbcf4d-bab4-4646-a6b3-c9277be07fd8 HTTP/1.1 Jul 12 17:43:43.824854 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:43:43.824854 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:43:43.824854 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:43:43.824854 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 0 Jul 12 17:43:43.824854 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:43:43.824854 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:43:43.824854 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:43:43.824854 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:43:43.824854 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbHBn2P0AAPTeyjvRqGGm6Weg8HxPH-97n_6a8wVovT5QO-_rMGfsCxsgiu9EaBIW-KFncOPHrJH7Qnqsze2YkwIJvtmH_T_TgjuioF1uYFHDL21pP5xK7Y-mYfYQH4WSfEr_stqyIxKbKplZI_fQ0LBE7l4xFC8cVH7u9H_iS3Qd18 Jul 12 17:43:43.824854 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:43:43.824854 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:43:43.824854 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:43:43.824854 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:43:43.824854 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:43:43.824854 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:43:43.824854 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: 497c73f9a78743e9b24b2b6ff47d7ede Jul 12 17:43:43.824854 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-151557955 Jul 12 17:43:43.824854 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:43:43.824854 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:43:43.827805 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/497c73f9a78743e9b24b2b6ff47d7ede"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_497c73f9a78743e9b24b2b6ff47d7ede", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/497c73f9a78743e9b24b2b6ff47d7ede"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/497c73f9a78743e9b24b2b6ff47d7ede"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:43:43.827805 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-ServerRescueNegativeTestJSON-151557955 Jul 12 17:43:43.827805 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: 497c73f9a78743e9b24b2b6ff47d7ede Jul 12 17:43:43.827805 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-151557955 Jul 12 17:43:43.827805 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-ServerRescueNegativeTestJSON-151557955-project Jul 12 17:43:43.827805 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:43:43.827805 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:43:43.827805 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: ce09df98c929416e8ca67b0728349bfb Jul 12 17:43:43.827805 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-ServerRescueNegativeTestJSON-151557955-project Jul 12 17:43:43.827805 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: > Jul 12 17:43:43.827805 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Cannot 'detach_volume' instance eab0c8cd-6093-440a-8e95-c58ede89a22b while it is in vm_state rescued Jul 12 17:43:43.829228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'server_id': 'eab0c8cd-6093-440a-8e95-c58ede89a22b', 'id': '14fbcf4d-bab4-4646-a6b3-c9277be07fd8'} Jul 12 17:43:43.829228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:43:43.829228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:43:43.829228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 12 17:43:43.829228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 12 17:43:43.829228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 17:43:43.829228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 17:43:43.829228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 12 17:43:43.829228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 12 17:43:43.829228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance eab0c8cd-6093-440a-8e95-c58ede89a22b in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 12 17:43:43.829228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:43:43.829228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:43:43.829228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:43:43.829228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:43:43.829228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:43:43.829228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:43:43.829228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:43:43.829228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:43:43.829228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:43:43.829228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:43:43.831621 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 12 17:43:43.831621 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 12 17:43:43.831621 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 12 17:43:43.831621 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 12 17:43:43.831621 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance eab0c8cd-6093-440a-8e95-c58ede89a22b while it is in vm_state rescued Jul 12 17:43:43.831621 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:43:43.831621 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:43:43.831621 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:43:43.831621 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:43:43.831621 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:43:43.831621 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:43:43.831621 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:43:43.831621 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:43:43.831621 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance eab0c8cd-6093-440a-8e95-c58ede89a22b while it is in vm_state rescued Jul 12 17:43:43.831621 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:43:43.831621 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-35b3b9c7-9a2f-4773-93c3-3d5c3fafb64d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Returning 409 to user: Cannot 'detach_volume' instance eab0c8cd-6093-440a-8e95-c58ede89a22b while it is in vm_state rescued {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:43:43.834976 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-35b3b9c7-9a2f-4773-93c3-3d5c3fafb64d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b/os-volume_attachments/14fbcf4d-bab4-4646-a6b3-c9277be07fd8" status: 409 len: 152 microversion: 2.1 time: 0.145453 Jul 12 17:43:43.834976 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 340/664] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jul 12 17:43:43 2022] DELETE /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b/os-volume_attachments/14fbcf4d-bab4-4646-a6b3-c9277be07fd8 => generated 152 bytes in 147 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 12 17:43:43.845664 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-a5ad07c3-5fd3-4ff3-bbbc-3410af99154b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:43:43.846786 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-a5ad07c3-5fd3-4ff3-bbbc-3410af99154b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:43.857819 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a5ad07c3-5fd3-4ff3-bbbc-3410af99154b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:43.859160 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a5ad07c3-5fd3-4ff3-bbbc-3410af99154b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:43.860718 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a5ad07c3-5fd3-4ff3-bbbc-3410af99154b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:43.861566 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a5ad07c3-5fd3-4ff3-bbbc-3410af99154b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:44.132618 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-a5ad07c3-5fd3-4ff3-bbbc-3410af99154b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "POST /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b/action" status: 202 len: 0 microversion: 2.1 time: 0.294514 Jul 12 17:43:44.133706 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 325/665] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jul 12 17:43:43 2022] POST /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:43:44.143556 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-2f9e8a8e-9c7f-4484-9af8-2e853ccd427d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:44.145148 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-2f9e8a8e-9c7f-4484-9af8-2e853ccd427d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:44.153193 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2f9e8a8e-9c7f-4484-9af8-2e853ccd427d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:44.153857 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2f9e8a8e-9c7f-4484-9af8-2e853ccd427d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:44.155045 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2f9e8a8e-9c7f-4484-9af8-2e853ccd427d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:44.155591 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2f9e8a8e-9c7f-4484-9af8-2e853ccd427d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:44.384008 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-2f9e8a8e-9c7f-4484-9af8-2e853ccd427d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:44.395119 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-2f9e8a8e-9c7f-4484-9af8-2e853ccd427d tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1720 microversion: 2.1 time: 0.255531 Jul 12 17:43:44.399300 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 341/666] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:44 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1720 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:43:45.415909 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-2355b473-6472-4031-afdf-9320a2eb1000 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:45.416841 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-2355b473-6472-4031-afdf-9320a2eb1000 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:45.424070 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2355b473-6472-4031-afdf-9320a2eb1000 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:45.426284 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2355b473-6472-4031-afdf-9320a2eb1000 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:45.426284 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2355b473-6472-4031-afdf-9320a2eb1000 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:45.426284 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2355b473-6472-4031-afdf-9320a2eb1000 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:45.586763 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-2355b473-6472-4031-afdf-9320a2eb1000 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:45.601888 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-2355b473-6472-4031-afdf-9320a2eb1000 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1720 microversion: 2.1 time: 0.191621 Jul 12 17:43:45.602966 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 326/667] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:45 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1720 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:46.620590 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-03fba366-3b4a-494f-9d20-a29dbd460e14 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:46.621202 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-03fba366-3b4a-494f-9d20-a29dbd460e14 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:46.628045 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-03fba366-3b4a-494f-9d20-a29dbd460e14 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:46.628502 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-03fba366-3b4a-494f-9d20-a29dbd460e14 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:46.629886 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-03fba366-3b4a-494f-9d20-a29dbd460e14 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:46.630452 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-03fba366-3b4a-494f-9d20-a29dbd460e14 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:46.776605 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-03fba366-3b4a-494f-9d20-a29dbd460e14 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:46.785908 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-03fba366-3b4a-494f-9d20-a29dbd460e14 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1720 microversion: 2.1 time: 0.169231 Jul 12 17:43:46.786527 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 342/668] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:46 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:47.809663 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-7f106db7-7579-407b-9aa7-a5306c83d85a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:47.810878 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-7f106db7-7579-407b-9aa7-a5306c83d85a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:47.823756 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7f106db7-7579-407b-9aa7-a5306c83d85a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:47.824210 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7f106db7-7579-407b-9aa7-a5306c83d85a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:47.825001 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7f106db7-7579-407b-9aa7-a5306c83d85a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:47.825446 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7f106db7-7579-407b-9aa7-a5306c83d85a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:48.007645 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-7f106db7-7579-407b-9aa7-a5306c83d85a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:48.019105 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-7f106db7-7579-407b-9aa7-a5306c83d85a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1726 microversion: 2.1 time: 0.217824 Jul 12 17:43:48.021351 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 327/669] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:47 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1726 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:48.040924 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a1cb2255-4ee5-4bb0-b991-d78d06691170 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:48.041772 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-a1cb2255-4ee5-4bb0-b991-d78d06691170 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:48.053338 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a1cb2255-4ee5-4bb0-b991-d78d06691170 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:48.054142 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a1cb2255-4ee5-4bb0-b991-d78d06691170 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:48.055108 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a1cb2255-4ee5-4bb0-b991-d78d06691170 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:48.055546 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a1cb2255-4ee5-4bb0-b991-d78d06691170 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:48.141877 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-a1cb2255-4ee5-4bb0-b991-d78d06691170 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107508 Jul 12 17:43:48.142914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 343/670] 10.222.0.16 () {58 vars in 1274 bytes} [Tue Jul 12 17:43:48 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:43:49.318677 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-42d6a381-9042-4ad9-bd08-18448a01527b req-07d292ca-fbac-4eac-89d6-14acd4cba0d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eab0c8cd-6093-440a-8e95-c58ede89a22b", "tag": "77716f74-a80f-4027-974a-c1c872d5c606"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:43:49.333320 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-42d6a381-9042-4ad9-bd08-18448a01527b req-07d292ca-fbac-4eac-89d6-14acd4cba0d5 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:49.334748 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-42d6a381-9042-4ad9-bd08-18448a01527b req-07d292ca-fbac-4eac-89d6-14acd4cba0d5 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:49.356937 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-42d6a381-9042-4ad9-bd08-18448a01527b req-07d292ca-fbac-4eac-89d6-14acd4cba0d5 service nova] Creating event network-changed:77716f74-a80f-4027-974a-c1c872d5c606 for instance eab0c8cd-6093-440a-8e95-c58ede89a22b on hv-cinder-84875 Jul 12 17:43:49.363062 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-42d6a381-9042-4ad9-bd08-18448a01527b req-07d292ca-fbac-4eac-89d6-14acd4cba0d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048929 Jul 12 17:43:49.363062 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 328/671] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:43:51.378354 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-685483f7-f4a5-44a3-8d14-045e22605cd1 req-c8a77b31-768b-494a-9769-a2b027d0b127 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eab0c8cd-6093-440a-8e95-c58ede89a22b", "tag": "77716f74-a80f-4027-974a-c1c872d5c606"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:43:51.382793 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_api:SELECT=64 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:43:51.388319 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-685483f7-f4a5-44a3-8d14-045e22605cd1 req-c8a77b31-768b-494a-9769-a2b027d0b127 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:51.396558 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-685483f7-f4a5-44a3-8d14-045e22605cd1 req-c8a77b31-768b-494a-9769-a2b027d0b127 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:51.403325 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-685483f7-f4a5-44a3-8d14-045e22605cd1 req-c8a77b31-768b-494a-9769-a2b027d0b127 service nova] Creating event network-changed:77716f74-a80f-4027-974a-c1c872d5c606 for instance eab0c8cd-6093-440a-8e95-c58ede89a22b on hv-cinder-84875 Jul 12 17:43:51.408682 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-685483f7-f4a5-44a3-8d14-045e22605cd1 req-c8a77b31-768b-494a-9769-a2b027d0b127 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034505 Jul 12 17:43:51.409508 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 344/672] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:44:03.623586 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_api:SELECT=19 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:44:03.624367 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:44:03.628837 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-6e3f82c2-5643-46ff-8d42-4fc7da79a0ea tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:03.629990 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-6e3f82c2-5643-46ff-8d42-4fc7da79a0ea tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:03.636487 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6e3f82c2-5643-46ff-8d42-4fc7da79a0ea tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:03.640895 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6e3f82c2-5643-46ff-8d42-4fc7da79a0ea tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:03.640895 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6e3f82c2-5643-46ff-8d42-4fc7da79a0ea tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:03.640895 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6e3f82c2-5643-46ff-8d42-4fc7da79a0ea tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:03.673247 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-6e3f82c2-5643-46ff-8d42-4fc7da79a0ea tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699/os-volume_attachments/c9d164eb-0a27-4384-b031-2ceb13658fca" status: 200 len: 194 microversion: 2.20 time: 0.051212 Jul 12 17:44:03.673941 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 329/673] 10.222.0.16 () {60 vars in 1453 bytes} [Tue Jul 12 17:44:03 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699/os-volume_attachments/c9d164eb-0a27-4384-b031-2ceb13658fca => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:44:03.748313 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-378d9935-62b0-4e0a-af2c-0fe8d77d1797 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:03.748944 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-378d9935-62b0-4e0a-af2c-0fe8d77d1797 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:03.751656 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=64 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:44:03.757346 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-378d9935-62b0-4e0a-af2c-0fe8d77d1797 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:03.757795 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-378d9935-62b0-4e0a-af2c-0fe8d77d1797 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:03.758604 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-378d9935-62b0-4e0a-af2c-0fe8d77d1797 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:03.759045 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-378d9935-62b0-4e0a-af2c-0fe8d77d1797 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:04.023716 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.objects.instance [None req-378d9935-62b0-4e0a-af2c-0fe8d77d1797 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lazy-loading 'services' on Instance uuid 7f88418d-5f96-4c05-adf4-09d83f045699 {{(pid=130059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:44:04.224704 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-378d9935-62b0-4e0a-af2c-0fe8d77d1797 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699/os-volume_attachments/c9d164eb-0a27-4384-b031-2ceb13658fca" status: 202 len: 0 microversion: 2.20 time: 0.481447 Jul 12 17:44:04.225310 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 345/674] 10.222.0.16 () {60 vars in 1456 bytes} [Tue Jul 12 17:44:03 2022] DELETE /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699/os-volume_attachments/c9d164eb-0a27-4384-b031-2ceb13658fca => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:44:04.237371 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-0ed108d5-ab91-41ff-9142-9da4b00a8b7c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:04.239060 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-0ed108d5-ab91-41ff-9142-9da4b00a8b7c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:04.249201 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ed108d5-ab91-41ff-9142-9da4b00a8b7c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:04.249657 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ed108d5-ab91-41ff-9142-9da4b00a8b7c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:04.250458 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ed108d5-ab91-41ff-9142-9da4b00a8b7c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:04.250909 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ed108d5-ab91-41ff-9142-9da4b00a8b7c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:04.284056 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-0ed108d5-ab91-41ff-9142-9da4b00a8b7c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053458 Jul 12 17:44:04.284639 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 330/675] 10.222.0.16 () {60 vars in 1342 bytes} [Tue Jul 12 17:44:04 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:44:05.298878 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-092630cb-659c-44cb-a5b6-787a4f4fc930 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:05.299931 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-092630cb-659c-44cb-a5b6-787a4f4fc930 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:05.306549 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-092630cb-659c-44cb-a5b6-787a4f4fc930 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:05.307007 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-092630cb-659c-44cb-a5b6-787a4f4fc930 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:05.307799 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-092630cb-659c-44cb-a5b6-787a4f4fc930 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:05.308241 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-092630cb-659c-44cb-a5b6-787a4f4fc930 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:05.340267 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-092630cb-659c-44cb-a5b6-787a4f4fc930 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046447 Jul 12 17:44:05.340851 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 346/676] 10.222.0.16 () {60 vars in 1342 bytes} [Tue Jul 12 17:44:05 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:44:05.966832 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-79fa25ba-4083-41f0-bfb5-acb81d15e497 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:44:05.967826 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-79fa25ba-4083-41f0-bfb5-acb81d15e497 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:05.974690 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-79fa25ba-4083-41f0-bfb5-acb81d15e497 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:05.975153 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-79fa25ba-4083-41f0-bfb5-acb81d15e497 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:05.975936 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-79fa25ba-4083-41f0-bfb5-acb81d15e497 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:05.976380 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-79fa25ba-4083-41f0-bfb5-acb81d15e497 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:06.223759 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-79fa25ba-4083-41f0-bfb5-acb81d15e497 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "POST /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72/action" status: 202 len: 0 microversion: 2.1 time: 0.261066 Jul 12 17:44:06.226001 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 331/677] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jul 12 17:44:05 2022] POST /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:44:06.232506 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-806962d6-4444-4b1d-a849-125e13b2eb94 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:06.233110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-806962d6-4444-4b1d-a849-125e13b2eb94 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:06.239398 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-806962d6-4444-4b1d-a849-125e13b2eb94 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:06.239847 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-806962d6-4444-4b1d-a849-125e13b2eb94 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:06.240617 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-806962d6-4444-4b1d-a849-125e13b2eb94 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:06.241129 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-806962d6-4444-4b1d-a849-125e13b2eb94 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:06.354499 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-033c7035-ed46-4d49-abe6-eaf9e9f4f3bf tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:06.355617 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-033c7035-ed46-4d49-abe6-eaf9e9f4f3bf tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:06.361856 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-033c7035-ed46-4d49-abe6-eaf9e9f4f3bf tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:06.362393 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-033c7035-ed46-4d49-abe6-eaf9e9f4f3bf tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:06.363186 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-033c7035-ed46-4d49-abe6-eaf9e9f4f3bf tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:06.363622 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-033c7035-ed46-4d49-abe6-eaf9e9f4f3bf tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:06.393994 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-806962d6-4444-4b1d-a849-125e13b2eb94 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:06.399183 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-033c7035-ed46-4d49-abe6-eaf9e9f4f3bf tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049938 Jul 12 17:44:06.400386 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 332/678] 10.222.0.16 () {60 vars in 1342 bytes} [Tue Jul 12 17:44:06 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:44:06.407945 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-806962d6-4444-4b1d-a849-125e13b2eb94 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1748 microversion: 2.1 time: 0.179317 Jul 12 17:44:06.408552 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 347/679] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:06 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1748 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:44:06.461784 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-cf680acd-1704-4cb7-83a5-e1cba3a6d91c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:06.462319 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-cf680acd-1704-4cb7-83a5-e1cba3a6d91c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:06.468559 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cf680acd-1704-4cb7-83a5-e1cba3a6d91c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:06.469016 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cf680acd-1704-4cb7-83a5-e1cba3a6d91c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:06.469806 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cf680acd-1704-4cb7-83a5-e1cba3a6d91c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:06.470245 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cf680acd-1704-4cb7-83a5-e1cba3a6d91c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:06.497868 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-cf680acd-1704-4cb7-83a5-e1cba3a6d91c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Going to try to terminate instance {{(pid=130058) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:44:06.819772 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-cf680acd-1704-4cb7-83a5-e1cba3a6d91c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 204 len: 0 microversion: 2.20 time: 0.362268 Jul 12 17:44:06.820371 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 333/680] 10.222.0.16 () {60 vars in 1279 bytes} [Tue Jul 12 17:44:06 2022] DELETE /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 17:44:06.828781 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-984189cb-487e-4729-a842-73dae3d32858 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:06.829396 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-984189cb-487e-4729-a842-73dae3d32858 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:06.836840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-984189cb-487e-4729-a842-73dae3d32858 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:06.837381 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-984189cb-487e-4729-a842-73dae3d32858 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:06.838165 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-984189cb-487e-4729-a842-73dae3d32858 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:06.838641 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-984189cb-487e-4729-a842-73dae3d32858 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:06.979973 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-984189cb-487e-4729-a842-73dae3d32858 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:06.988501 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-984189cb-487e-4729-a842-73dae3d32858 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:06.995169 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-984189cb-487e-4729-a842-73dae3d32858 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:06.995169 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-984189cb-487e-4729-a842-73dae3d32858 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1721 microversion: 2.20 time: 0.166603 Jul 12 17:44:06.995169 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 348/681] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:44:06 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:44:07.427708 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-d53c9e41-75ef-4e25-9e73-e6a4dd8524e5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:07.428636 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-d53c9e41-75ef-4e25-9e73-e6a4dd8524e5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:07.435817 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d53c9e41-75ef-4e25-9e73-e6a4dd8524e5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:07.436252 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d53c9e41-75ef-4e25-9e73-e6a4dd8524e5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:07.437055 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d53c9e41-75ef-4e25-9e73-e6a4dd8524e5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:07.437501 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d53c9e41-75ef-4e25-9e73-e6a4dd8524e5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:07.661650 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-d53c9e41-75ef-4e25-9e73-e6a4dd8524e5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:07.671208 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-d53c9e41-75ef-4e25-9e73-e6a4dd8524e5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1748 microversion: 2.1 time: 0.248050 Jul 12 17:44:07.673913 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 334/682] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:07 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1748 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:08.012757 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ae669878-5619-47f6-b474-5ae0ad4cf23d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:08.013377 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-ae669878-5619-47f6-b474-5ae0ad4cf23d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:08.020935 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ae669878-5619-47f6-b474-5ae0ad4cf23d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:08.021385 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ae669878-5619-47f6-b474-5ae0ad4cf23d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:08.022165 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ae669878-5619-47f6-b474-5ae0ad4cf23d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:08.022636 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ae669878-5619-47f6-b474-5ae0ad4cf23d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:08.182247 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-ae669878-5619-47f6-b474-5ae0ad4cf23d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:08.190819 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-ae669878-5619-47f6-b474-5ae0ad4cf23d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:08.193022 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-ae669878-5619-47f6-b474-5ae0ad4cf23d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:08.194505 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-ae669878-5619-47f6-b474-5ae0ad4cf23d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1721 microversion: 2.20 time: 0.185765 Jul 12 17:44:08.195074 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 349/683] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:44:08 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:44:08.689443 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-dedfb489-124d-4e98-844d-132f611bfd71 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:08.690059 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-dedfb489-124d-4e98-844d-132f611bfd71 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:08.697177 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-dedfb489-124d-4e98-844d-132f611bfd71 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:08.698538 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-dedfb489-124d-4e98-844d-132f611bfd71 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:08.698538 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-dedfb489-124d-4e98-844d-132f611bfd71 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:08.698904 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-dedfb489-124d-4e98-844d-132f611bfd71 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:08.849296 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-dedfb489-124d-4e98-844d-132f611bfd71 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:08.857397 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-dedfb489-124d-4e98-844d-132f611bfd71 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1748 microversion: 2.1 time: 0.171970 Jul 12 17:44:08.857976 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 335/684] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:08 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1748 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:44:09.213434 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a4cee1a3-1545-41bf-83ea-2c6e4752fe9e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:09.214043 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-a4cee1a3-1545-41bf-83ea-2c6e4752fe9e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:09.220614 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a4cee1a3-1545-41bf-83ea-2c6e4752fe9e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:09.221069 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a4cee1a3-1545-41bf-83ea-2c6e4752fe9e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:09.221841 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a4cee1a3-1545-41bf-83ea-2c6e4752fe9e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:09.222276 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a4cee1a3-1545-41bf-83ea-2c6e4752fe9e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:09.445001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a4cee1a3-1545-41bf-83ea-2c6e4752fe9e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:09.452961 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a4cee1a3-1545-41bf-83ea-2c6e4752fe9e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:09.454470 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a4cee1a3-1545-41bf-83ea-2c6e4752fe9e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:09.455627 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-a4cee1a3-1545-41bf-83ea-2c6e4752fe9e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1721 microversion: 2.20 time: 0.246129 Jul 12 17:44:09.456187 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 350/685] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:44:09 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1721 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:44:09.874646 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-48f14011-5621-41bb-919e-3f614bf050b9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:09.875247 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-48f14011-5621-41bb-919e-3f614bf050b9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:09.882963 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-48f14011-5621-41bb-919e-3f614bf050b9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:09.888274 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-48f14011-5621-41bb-919e-3f614bf050b9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:09.888274 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-48f14011-5621-41bb-919e-3f614bf050b9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:09.888274 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-48f14011-5621-41bb-919e-3f614bf050b9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:09.953352 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-ab8eda5d-b6b7-4d07-93a2-776ef370c855 req-53aaeb35-85c3-49f6-a789-2891479d87a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f88418d-5f96-4c05-adf4-09d83f045699", "name": "network-vif-deleted", "tag": "082490a4-d27d-40c5-93fa-92a28b71e068"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:44:09.964120 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-ab8eda5d-b6b7-4d07-93a2-776ef370c855 req-53aaeb35-85c3-49f6-a789-2891479d87a8 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:09.971250 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-ab8eda5d-b6b7-4d07-93a2-776ef370c855 req-53aaeb35-85c3-49f6-a789-2891479d87a8 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:09.979401 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-ab8eda5d-b6b7-4d07-93a2-776ef370c855 req-53aaeb35-85c3-49f6-a789-2891479d87a8 service nova] Creating event network-vif-deleted:082490a4-d27d-40c5-93fa-92a28b71e068 for instance 7f88418d-5f96-4c05-adf4-09d83f045699 on hv-cinder-84875 Jul 12 17:44:09.991022 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-ab8eda5d-b6b7-4d07-93a2-776ef370c855 req-53aaeb35-85c3-49f6-a789-2891479d87a8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042817 Jul 12 17:44:09.991769 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 351/686] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:44:10.065425 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-48f14011-5621-41bb-919e-3f614bf050b9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:10.075186 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-48f14011-5621-41bb-919e-3f614bf050b9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1753 microversion: 2.1 time: 0.204304 Jul 12 17:44:10.076082 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 336/687] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:09 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1753 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:10.475819 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-f9a1f407-8ee1-4d6c-be06-f65393131d4c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:10.476573 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-f9a1f407-8ee1-4d6c-be06-f65393131d4c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:10.483381 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f9a1f407-8ee1-4d6c-be06-f65393131d4c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:10.483775 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f9a1f407-8ee1-4d6c-be06-f65393131d4c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:10.484560 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f9a1f407-8ee1-4d6c-be06-f65393131d4c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:10.485005 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f9a1f407-8ee1-4d6c-be06-f65393131d4c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:10.518360 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f9a1f407-8ee1-4d6c-be06-f65393131d4c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:10.518849 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f9a1f407-8ee1-4d6c-be06-f65393131d4c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:10.519310 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.objects.instance [None req-f9a1f407-8ee1-4d6c-be06-f65393131d4c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lazy-loading 'fault' on Instance uuid 7f88418d-5f96-4c05-adf4-09d83f045699 {{(pid=130059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:44:10.563725 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-f9a1f407-8ee1-4d6c-be06-f65393131d4c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:10.576050 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-f9a1f407-8ee1-4d6c-be06-f65393131d4c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:10.577851 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-f9a1f407-8ee1-4d6c-be06-f65393131d4c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:10.579373 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-f9a1f407-8ee1-4d6c-be06-f65393131d4c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 200 len: 1369 microversion: 2.20 time: 0.108362 Jul 12 17:44:10.579951 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 352/688] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:44:10 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 1369 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:44:11.094421 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-0b3c71ff-5bcb-48cb-aec6-d0b2cfd7a149 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:11.094993 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-0b3c71ff-5bcb-48cb-aec6-d0b2cfd7a149 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:11.103800 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0b3c71ff-5bcb-48cb-aec6-d0b2cfd7a149 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:11.104256 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0b3c71ff-5bcb-48cb-aec6-d0b2cfd7a149 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:11.105032 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0b3c71ff-5bcb-48cb-aec6-d0b2cfd7a149 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:11.105469 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0b3c71ff-5bcb-48cb-aec6-d0b2cfd7a149 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:11.255524 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0b3c71ff-5bcb-48cb-aec6-d0b2cfd7a149 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:11.263428 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-0b3c71ff-5bcb-48cb-aec6-d0b2cfd7a149 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1753 microversion: 2.1 time: 0.173868 Jul 12 17:44:11.263998 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 337/689] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:11 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1753 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:11.603131 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a0d223af-a433-446f-8c6d-699276c0ddf3 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:11.603747 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-a0d223af-a433-446f-8c6d-699276c0ddf3 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:11.609764 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a0d223af-a433-446f-8c6d-699276c0ddf3 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:11.610830 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a0d223af-a433-446f-8c6d-699276c0ddf3 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:11.611073 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a0d223af-a433-446f-8c6d-699276c0ddf3 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:11.611516 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a0d223af-a433-446f-8c6d-699276c0ddf3 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:11.625756 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-a0d223af-a433-446f-8c6d-699276c0ddf3 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] HTTP exception thrown: Instance 7f88418d-5f96-4c05-adf4-09d83f045699 could not be found. Jul 12 17:44:11.627467 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a0d223af-a433-446f-8c6d-699276c0ddf3 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Request method failure captured: Jul 12 17:44:11.627467 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 HTTP/1.1 Jul 12 17:44:11.627467 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:44:11.627467 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:44:11.627467 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:44:11.627467 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 0 Jul 12 17:44:11.627467 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:44:11.627467 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:44:11.627467 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:44:11.627467 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:44:11.627467 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbHFQ7sUnYCKjKjCnGOE2JO95ulUmkw4gdbuIOyIGzCWuZAANUJ8MDnNZ3jvnVVQVGbWAywYnJ-rPvCjRNUtHvlJXEMsKebSZeUhjllYWrTIMwqa0z1JZYx9Cb0AEwzGs7un35qDttf7w1T8RKRClaLWuwTxZXXKoDOK0L_0d6QtWtQ Jul 12 17:44:11.627467 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:44:11.627467 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:44:11.627467 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:44:11.627467 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:44:11.627467 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 17:44:11.627467 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:44:11.627467 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:44:11.627467 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: 49227e443aa94a438bf7954aa0398cb9 Jul 12 17:44:11.627467 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-596445083 Jul 12 17:44:11.627467 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:44:11.627467 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:44:11.629247 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/49227e443aa94a438bf7954aa0398cb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_49227e443aa94a438bf7954aa0398cb9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/49227e443aa94a438bf7954aa0398cb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/49227e443aa94a438bf7954aa0398cb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:44:11.629247 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-AttachVolumeShelveTestJSON-596445083 Jul 12 17:44:11.629247 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: 49227e443aa94a438bf7954aa0398cb9 Jul 12 17:44:11.629247 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-596445083 Jul 12 17:44:11.629247 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-AttachVolumeShelveTestJSON-596445083-project Jul 12 17:44:11.629247 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:44:11.629247 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:44:11.629247 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: 9feeaf257bb441b7a14b57f1f493d08f Jul 12 17:44:11.629247 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-AttachVolumeShelveTestJSON-596445083-project Jul 12 17:44:11.629247 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: > Jul 12 17:44:11.629247 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Instance 7f88418d-5f96-4c05-adf4-09d83f045699 could not be found. Jul 12 17:44:11.629247 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'id': '7f88418d-5f96-4c05-adf4-09d83f045699'} Jul 12 17:44:11.630270 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:44:11.630270 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:44:11.630270 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:44:11.630270 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:44:11.630270 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:44:11.630270 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:44:11.630270 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:44:11.630270 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:44:11.630270 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:44:11.630270 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:44:11.630270 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f88418d-5f96-4c05-adf4-09d83f045699 could not be found. Jul 12 17:44:11.630270 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:44:11.630270 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:44:11.630270 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:44:11.630270 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:44:11.630270 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:44:11.630270 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:44:11.630270 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:44:11.630270 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:44:11.630270 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:44:11.631767 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:44:11.631767 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:44:11.631767 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:44:11.631767 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:44:11.631767 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:44:11.631767 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:44:11.631767 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:44:11.631767 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f88418d-5f96-4c05-adf4-09d83f045699 could not be found. Jul 12 17:44:11.631767 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:44:11.631767 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:44:11.631767 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:44:11.631767 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:44:11.631767 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:44:11.631767 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:44:11.631767 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:44:11.631767 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:44:11.631767 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f88418d-5f96-4c05-adf4-09d83f045699 could not be found. Jul 12 17:44:11.631767 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:44:11.633374 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a0d223af-a433-446f-8c6d-699276c0ddf3 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Returning 404 to user: Instance 7f88418d-5f96-4c05-adf4-09d83f045699 could not be found. {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:44:11.633374 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-a0d223af-a433-446f-8c6d-699276c0ddf3 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 404 len: 111 microversion: 2.20 time: 0.030084 Jul 12 17:44:11.633374 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 353/690] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:44:11 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 17:44:11.638209 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-86fac83c-433a-45be-9c39-83abeaf2bb79 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '.version_select at 0x7f479fca9040>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:11.751531 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-86fac83c-433a-45be-9c39-83abeaf2bb79 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-945957238" status: 204 len: 0 microversion: 2.20 time: 0.117254 Jul 12 17:44:11.752178 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 338/691] 10.222.0.16 () {60 vars in 1258 bytes} [Tue Jul 12 17:44:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-945957238 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 17:44:12.282688 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-9b08faec-3c5d-41c1-90aa-bcf2e9670ae9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:12.283319 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-9b08faec-3c5d-41c1-90aa-bcf2e9670ae9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:12.290057 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9b08faec-3c5d-41c1-90aa-bcf2e9670ae9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:12.290973 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9b08faec-3c5d-41c1-90aa-bcf2e9670ae9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:12.292004 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9b08faec-3c5d-41c1-90aa-bcf2e9670ae9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:12.292630 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9b08faec-3c5d-41c1-90aa-bcf2e9670ae9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:12.480141 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-9b08faec-3c5d-41c1-90aa-bcf2e9670ae9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:12.500441 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-9b08faec-3c5d-41c1-90aa-bcf2e9670ae9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1753 microversion: 2.1 time: 0.222541 Jul 12 17:44:12.502205 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 354/692] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:12 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1753 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:44:12.609414 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-4943a490-5299-40ab-a5bc-289cbdc788e0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Action: 'create', calling method: .version_select at 0x7f479fc21430>, body: {"keypair": {"name": "tempest-keypair-618324942", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAAV2OLjk7clasinE0iXqN0Z0zmJBIlJJvKHTA4NapikNcZX/WNEYBNoKhmk5LMFmEABnh4NG1/A/WWG2UcmxZNeGUXrPT00QGzRnbZKq2hLKcZDp1TAocsysThaoJ6HA=="}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:44:12.627519 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-4943a490-5299-40ab-a5bc-289cbdc788e0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Getting quotas for project 49227e443aa94a438bf7954aa0398cb9. Resources: {'key_pairs'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:44:12.632276 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-4943a490-5299-40ab-a5bc-289cbdc788e0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Getting quotas for user 9feeaf257bb441b7a14b57f1f493d08f and project 49227e443aa94a438bf7954aa0398cb9. Resources: {'key_pairs'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:44:12.723884 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-4943a490-5299-40ab-a5bc-289cbdc788e0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.118755 Jul 12 17:44:12.724494 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 339/693] 10.222.0.16 () {62 vars in 1199 bytes} [Tue Jul 12 17:44:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 120 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 12 17:44:13.526863 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a33a180c-2691-491d-8914-37aebfa91362 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:13.527715 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-a33a180c-2691-491d-8914-37aebfa91362 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:13.536371 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a33a180c-2691-491d-8914-37aebfa91362 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:13.536371 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a33a180c-2691-491d-8914-37aebfa91362 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:13.536371 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a33a180c-2691-491d-8914-37aebfa91362 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:13.536739 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a33a180c-2691-491d-8914-37aebfa91362 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:13.697667 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a33a180c-2691-491d-8914-37aebfa91362 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:13.705652 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-a33a180c-2691-491d-8914-37aebfa91362 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1753 microversion: 2.1 time: 0.182682 Jul 12 17:44:13.708297 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 355/694] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:13 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1753 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:14.723888 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-1b4c4582-77a7-463e-979c-babb18ef26e5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:14.724775 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-1b4c4582-77a7-463e-979c-babb18ef26e5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:14.731798 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1b4c4582-77a7-463e-979c-babb18ef26e5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:14.732243 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1b4c4582-77a7-463e-979c-babb18ef26e5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:14.733012 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1b4c4582-77a7-463e-979c-babb18ef26e5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:14.733474 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1b4c4582-77a7-463e-979c-babb18ef26e5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:14.887817 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-1b4c4582-77a7-463e-979c-babb18ef26e5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:14.897309 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-1b4c4582-77a7-463e-979c-babb18ef26e5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1753 microversion: 2.1 time: 0.178126 Jul 12 17:44:14.902047 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 340/695] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:14 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1753 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:44:14.971356 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-7552e487-5d5c-4a98-81cf-3bbf9908006c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-110975065", "imageRef": "cb077f42-97cd-41cf-8758-764c562534f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4232e454-e413-42a8-88d8-67ab35c6cfbd"}], "security_groups": [{"name": "tempest-securitygroup--1994856347"}], "key_name": "tempest-keypair-618324942", "user_data": "}} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:44:15.077738 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.network.neutron [None req-7552e487-5d5c-4a98-81cf-3bbf9908006c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] validate_networks() for [('4232e454-e413-42a8-88d8-67ab35c6cfbd', None, None, None, None, None)] {{(pid=130059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:44:15.462006 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-7552e487-5d5c-4a98-81cf-3bbf9908006c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Flavor limits 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:44:15.462467 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-7552e487-5d5c-4a98-81cf-3bbf9908006c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Image limits 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:44:15.462960 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-7552e487-5d5c-4a98-81cf-3bbf9908006c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Flavor pref 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:44:15.463376 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-7552e487-5d5c-4a98-81cf-3bbf9908006c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Image pref 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:44:15.463795 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-7552e487-5d5c-4a98-81cf-3bbf9908006c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:44:15.473369 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7552e487-5d5c-4a98-81cf-3bbf9908006c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:15.473827 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7552e487-5d5c-4a98-81cf-3bbf9908006c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:15.474691 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7552e487-5d5c-4a98-81cf-3bbf9908006c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:15.475132 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7552e487-5d5c-4a98-81cf-3bbf9908006c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:15.492771 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.quota [None req-7552e487-5d5c-4a98-81cf-3bbf9908006c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Getting quotas for project 49227e443aa94a438bf7954aa0398cb9. Resources: {'cores', 'instances', 'ram'} {{(pid=130059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:44:15.496797 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.quota [None req-7552e487-5d5c-4a98-81cf-3bbf9908006c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Getting quotas for user 9feeaf257bb441b7a14b57f1f493d08f and project 49227e443aa94a438bf7954aa0398cb9. Resources: {'cores', 'instances', 'ram'} {{(pid=130059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:44:15.508219 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-7552e487-5d5c-4a98-81cf-3bbf9908006c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Going to run 1 instances... {{(pid=130059) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:44:15.510506 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-7552e487-5d5c-4a98-81cf-3bbf9908006c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb077f42-97cd-41cf-8758-764c562534f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:44:15.643866 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-7552e487-5d5c-4a98-81cf-3bbf9908006c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.676316 Jul 12 17:44:15.645779 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 356/696] 10.222.0.16 () {62 vars in 1187 bytes} [Tue Jul 12 17:44:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 12 17:44:15.655493 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-e8746298-7f50-49fa-9a4e-a330e0716220 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:15.656094 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-e8746298-7f50-49fa-9a4e-a330e0716220 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:15.712511 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-e8746298-7f50-49fa-9a4e-a330e0716220 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:15.720021 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-e8746298-7f50-49fa-9a4e-a330e0716220 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:15.721877 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-e8746298-7f50-49fa-9a4e-a330e0716220 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:15.723621 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-e8746298-7f50-49fa-9a4e-a330e0716220 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1280 microversion: 2.20 time: 0.071460 Jul 12 17:44:15.724366 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 341/697] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:44:15 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:44:15.918810 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-e8137b94-e92b-4041-8b9e-c8c5c3a90e44 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:15.919454 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-e8137b94-e92b-4041-8b9e-c8c5c3a90e44 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:15.926615 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e8137b94-e92b-4041-8b9e-c8c5c3a90e44 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:15.927090 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e8137b94-e92b-4041-8b9e-c8c5c3a90e44 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:15.927872 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e8137b94-e92b-4041-8b9e-c8c5c3a90e44 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:15.928315 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e8137b94-e92b-4041-8b9e-c8c5c3a90e44 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:16.089191 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-e8137b94-e92b-4041-8b9e-c8c5c3a90e44 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:16.097244 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-e8137b94-e92b-4041-8b9e-c8c5c3a90e44 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1753 microversion: 2.1 time: 0.182325 Jul 12 17:44:16.097813 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 357/698] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:15 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1753 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:16.742756 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-e8fba3bc-3a59-4355-888e-d7702b42bc4b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:16.743460 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-e8fba3bc-3a59-4355-888e-d7702b42bc4b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:16.750203 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e8fba3bc-3a59-4355-888e-d7702b42bc4b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:16.750686 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e8fba3bc-3a59-4355-888e-d7702b42bc4b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:16.751458 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e8fba3bc-3a59-4355-888e-d7702b42bc4b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:16.751893 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e8fba3bc-3a59-4355-888e-d7702b42bc4b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:16.824722 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-e8fba3bc-3a59-4355-888e-d7702b42bc4b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:16.835281 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-e8fba3bc-3a59-4355-888e-d7702b42bc4b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:16.836849 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-e8fba3bc-3a59-4355-888e-d7702b42bc4b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:16.837988 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-e8fba3bc-3a59-4355-888e-d7702b42bc4b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1284 microversion: 2.20 time: 0.100045 Jul 12 17:44:16.838573 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 342/699] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:44:16 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:44:17.115424 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-e50e7ffc-52a6-46df-99ae-71af4f4dd256 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:17.116070 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-e50e7ffc-52a6-46df-99ae-71af4f4dd256 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:17.122779 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e50e7ffc-52a6-46df-99ae-71af4f4dd256 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:17.123301 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e50e7ffc-52a6-46df-99ae-71af4f4dd256 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:17.124068 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e50e7ffc-52a6-46df-99ae-71af4f4dd256 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:17.124511 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e50e7ffc-52a6-46df-99ae-71af4f4dd256 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:17.279600 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-e50e7ffc-52a6-46df-99ae-71af4f4dd256 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:17.287844 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-e50e7ffc-52a6-46df-99ae-71af4f4dd256 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1753 microversion: 2.1 time: 0.177137 Jul 12 17:44:17.288413 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 358/700] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:17 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:17.858244 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-97674543-3ba2-434b-8f35-99c4f66f8b31 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:17.858839 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-97674543-3ba2-434b-8f35-99c4f66f8b31 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:17.866406 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-97674543-3ba2-434b-8f35-99c4f66f8b31 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:17.866883 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-97674543-3ba2-434b-8f35-99c4f66f8b31 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:17.867662 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-97674543-3ba2-434b-8f35-99c4f66f8b31 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:17.868157 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-97674543-3ba2-434b-8f35-99c4f66f8b31 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:17.932899 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-97674543-3ba2-434b-8f35-99c4f66f8b31 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:17.941642 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-97674543-3ba2-434b-8f35-99c4f66f8b31 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:17.944407 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-97674543-3ba2-434b-8f35-99c4f66f8b31 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:17.945634 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-97674543-3ba2-434b-8f35-99c4f66f8b31 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1340 microversion: 2.20 time: 0.092286 Jul 12 17:44:17.951432 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 343/701] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:44:17 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1340 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:44:18.305648 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-828fb317-7fa0-4601-ba35-62745fd3854f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:18.306269 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-828fb317-7fa0-4601-ba35-62745fd3854f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:18.312798 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-828fb317-7fa0-4601-ba35-62745fd3854f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:18.313254 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-828fb317-7fa0-4601-ba35-62745fd3854f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:18.314085 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-828fb317-7fa0-4601-ba35-62745fd3854f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:18.314554 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-828fb317-7fa0-4601-ba35-62745fd3854f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:18.541337 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-828fb317-7fa0-4601-ba35-62745fd3854f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:18.550017 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-828fb317-7fa0-4601-ba35-62745fd3854f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1753 microversion: 2.1 time: 0.248845 Jul 12 17:44:18.559764 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 359/702] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:18 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1753 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:19.034673 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-140b3da5-e172-4a81-a1c9-53326b0b98b4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:19.035290 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-140b3da5-e172-4a81-a1c9-53326b0b98b4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:19.045933 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-140b3da5-e172-4a81-a1c9-53326b0b98b4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:19.046278 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-140b3da5-e172-4a81-a1c9-53326b0b98b4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:19.047090 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-140b3da5-e172-4a81-a1c9-53326b0b98b4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:19.047524 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-140b3da5-e172-4a81-a1c9-53326b0b98b4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:19.195020 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-140b3da5-e172-4a81-a1c9-53326b0b98b4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:19.203754 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-140b3da5-e172-4a81-a1c9-53326b0b98b4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:19.205547 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-140b3da5-e172-4a81-a1c9-53326b0b98b4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:19.206810 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-140b3da5-e172-4a81-a1c9-53326b0b98b4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1406 microversion: 2.20 time: 0.245460 Jul 12 17:44:19.207574 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 344/703] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:44:18 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:44:19.567773 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a1771e54-a6fd-4f96-852a-0a6299dd0a60 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:19.568495 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-a1771e54-a6fd-4f96-852a-0a6299dd0a60 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:19.577470 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a1771e54-a6fd-4f96-852a-0a6299dd0a60 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:19.581903 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a1771e54-a6fd-4f96-852a-0a6299dd0a60 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:19.581903 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a1771e54-a6fd-4f96-852a-0a6299dd0a60 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:19.581903 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a1771e54-a6fd-4f96-852a-0a6299dd0a60 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:19.814491 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a1771e54-a6fd-4f96-852a-0a6299dd0a60 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:19.823940 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-a1771e54-a6fd-4f96-852a-0a6299dd0a60 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1753 microversion: 2.1 time: 0.260546 Jul 12 17:44:19.824823 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 360/704] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:19 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1753 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:20.033665 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-ea07571c-8426-447d-8152-e7ef080eb1d0 req-a6d756b3-3b65-4ec8-b204-7ea399bea8c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07ad3f97-288d-4704-ad33-35bc58e94dfe", "tag": "c8a33017-1571-46b3-8afd-ee6981b1ac07"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:44:20.044267 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-ea07571c-8426-447d-8152-e7ef080eb1d0 req-a6d756b3-3b65-4ec8-b204-7ea399bea8c4 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:20.045256 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-ea07571c-8426-447d-8152-e7ef080eb1d0 req-a6d756b3-3b65-4ec8-b204-7ea399bea8c4 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:20.058992 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-ea07571c-8426-447d-8152-e7ef080eb1d0 req-a6d756b3-3b65-4ec8-b204-7ea399bea8c4 service nova] Creating event network-changed:c8a33017-1571-46b3-8afd-ee6981b1ac07 for instance 07ad3f97-288d-4704-ad33-35bc58e94dfe on hv-cinder-84875 Jul 12 17:44:20.062178 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-ea07571c-8426-447d-8152-e7ef080eb1d0 req-a6d756b3-3b65-4ec8-b204-7ea399bea8c4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033679 Jul 12 17:44:20.063546 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 345/705] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:44:20.226728 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-206a1f5e-5e51-4dc8-9846-e0909e6583b7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:20.227341 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-206a1f5e-5e51-4dc8-9846-e0909e6583b7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:20.233687 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-206a1f5e-5e51-4dc8-9846-e0909e6583b7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:20.235951 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-206a1f5e-5e51-4dc8-9846-e0909e6583b7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:20.237224 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-206a1f5e-5e51-4dc8-9846-e0909e6583b7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:20.237671 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-206a1f5e-5e51-4dc8-9846-e0909e6583b7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:20.456187 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-206a1f5e-5e51-4dc8-9846-e0909e6583b7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:20.465105 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-206a1f5e-5e51-4dc8-9846-e0909e6583b7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:20.466658 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-206a1f5e-5e51-4dc8-9846-e0909e6583b7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:20.467792 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-206a1f5e-5e51-4dc8-9846-e0909e6583b7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1406 microversion: 2.20 time: 0.245941 Jul 12 17:44:20.468364 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 361/706] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:44:20 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:44:20.843657 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-f31c329d-d7a9-4f32-a2d1-b44637bdf6d0 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:20.844367 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-f31c329d-d7a9-4f32-a2d1-b44637bdf6d0 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:20.850889 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f31c329d-d7a9-4f32-a2d1-b44637bdf6d0 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:20.851339 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f31c329d-d7a9-4f32-a2d1-b44637bdf6d0 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:20.852122 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f31c329d-d7a9-4f32-a2d1-b44637bdf6d0 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:20.852590 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f31c329d-d7a9-4f32-a2d1-b44637bdf6d0 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:20.872017 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:44:21.011803 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-f31c329d-d7a9-4f32-a2d1-b44637bdf6d0 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:21.020434 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-f31c329d-d7a9-4f32-a2d1-b44637bdf6d0 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1753 microversion: 2.1 time: 0.180968 Jul 12 17:44:21.021041 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 346/707] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:20 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1753 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:21.486147 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-3263c07d-3051-4f5a-a84e-1b37d9bdb631 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:21.486844 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-3263c07d-3051-4f5a-a84e-1b37d9bdb631 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:21.493390 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3263c07d-3051-4f5a-a84e-1b37d9bdb631 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:21.493848 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3263c07d-3051-4f5a-a84e-1b37d9bdb631 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:21.494660 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3263c07d-3051-4f5a-a84e-1b37d9bdb631 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:21.495103 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3263c07d-3051-4f5a-a84e-1b37d9bdb631 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:21.513758 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:44:21.633478 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-3263c07d-3051-4f5a-a84e-1b37d9bdb631 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:21.641874 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-3263c07d-3051-4f5a-a84e-1b37d9bdb631 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:21.643419 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-3263c07d-3051-4f5a-a84e-1b37d9bdb631 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:21.644542 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-3263c07d-3051-4f5a-a84e-1b37d9bdb631 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1406 microversion: 2.20 time: 0.162361 Jul 12 17:44:21.645109 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 362/708] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:44:21 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:44:22.038053 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-99584a2c-f83d-4219-a907-42db12149bd5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:22.038709 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-99584a2c-f83d-4219-a907-42db12149bd5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:22.045920 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-99584a2c-f83d-4219-a907-42db12149bd5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:22.046373 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-99584a2c-f83d-4219-a907-42db12149bd5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:22.047190 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-99584a2c-f83d-4219-a907-42db12149bd5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:22.047627 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-99584a2c-f83d-4219-a907-42db12149bd5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:22.197851 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-99584a2c-f83d-4219-a907-42db12149bd5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:22.206130 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-99584a2c-f83d-4219-a907-42db12149bd5 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1753 microversion: 2.1 time: 0.172092 Jul 12 17:44:22.206751 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 347/709] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:22 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:22.627459 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-32196940-19c7-4d89-9ab7-bd5152edbb80 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:22.628150 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-32196940-19c7-4d89-9ab7-bd5152edbb80 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:22.634919 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-32196940-19c7-4d89-9ab7-bd5152edbb80 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:22.635375 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-32196940-19c7-4d89-9ab7-bd5152edbb80 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:22.636368 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-32196940-19c7-4d89-9ab7-bd5152edbb80 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:22.636823 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-32196940-19c7-4d89-9ab7-bd5152edbb80 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:22.667472 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-ea4e4c93-fed6-41fa-bcd4-69e0c070ee90 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:22.668715 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-ea4e4c93-fed6-41fa-bcd4-69e0c070ee90 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:22.671342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-32196940-19c7-4d89-9ab7-bd5152edbb80 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f/ips" status: 200 len: 148 microversion: 2.1 time: 0.187390 Jul 12 17:44:22.672710 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 363/710] 10.222.0.16 () {58 vars in 1247 bytes} [Tue Jul 12 17:44:22 2022] GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f/ips => generated 148 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:44:22.678424 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ea4e4c93-fed6-41fa-bcd4-69e0c070ee90 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:22.679185 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ea4e4c93-fed6-41fa-bcd4-69e0c070ee90 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:22.682654 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ea4e4c93-fed6-41fa-bcd4-69e0c070ee90 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:22.683108 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ea4e4c93-fed6-41fa-bcd4-69e0c070ee90 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:22.841148 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ea4e4c93-fed6-41fa-bcd4-69e0c070ee90 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:22.849654 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ea4e4c93-fed6-41fa-bcd4-69e0c070ee90 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:22.851214 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ea4e4c93-fed6-41fa-bcd4-69e0c070ee90 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:22.852313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-ea4e4c93-fed6-41fa-bcd4-69e0c070ee90 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1406 microversion: 2.20 time: 0.193237 Jul 12 17:44:22.852954 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 348/711] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:44:22 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:44:23.224255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-9ebc266c-661e-477f-a947-fb1ce8fbef68 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:23.224936 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-9ebc266c-661e-477f-a947-fb1ce8fbef68 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:23.232168 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9ebc266c-661e-477f-a947-fb1ce8fbef68 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:23.232629 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9ebc266c-661e-477f-a947-fb1ce8fbef68 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:23.233424 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9ebc266c-661e-477f-a947-fb1ce8fbef68 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:23.234139 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9ebc266c-661e-477f-a947-fb1ce8fbef68 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:23.398785 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-9ebc266c-661e-477f-a947-fb1ce8fbef68 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:23.409416 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-9ebc266c-661e-477f-a947-fb1ce8fbef68 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1753 microversion: 2.1 time: 0.189686 Jul 12 17:44:23.410163 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 364/712] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:23 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1753 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:23.872175 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-201826f3-f21a-490b-af1b-aafcb1dc4801 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:23.872794 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-201826f3-f21a-490b-af1b-aafcb1dc4801 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:23.878958 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-201826f3-f21a-490b-af1b-aafcb1dc4801 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:23.879415 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-201826f3-f21a-490b-af1b-aafcb1dc4801 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:23.880857 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-201826f3-f21a-490b-af1b-aafcb1dc4801 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:23.881302 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-201826f3-f21a-490b-af1b-aafcb1dc4801 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:24.021066 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-201826f3-f21a-490b-af1b-aafcb1dc4801 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:24.029458 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-201826f3-f21a-490b-af1b-aafcb1dc4801 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:24.031001 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-201826f3-f21a-490b-af1b-aafcb1dc4801 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:24.032319 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-201826f3-f21a-490b-af1b-aafcb1dc4801 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1406 microversion: 2.20 time: 0.163970 Jul 12 17:44:24.032888 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 349/713] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:44:23 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:44:24.340099 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ef240f64-3718-4a9d-ab9f-8d26ba89873a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11ff5088-aaff-41ed-ab8c-5a82d60cd082"}} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:44:24.341237 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-ef240f64-3718-4a9d-ab9f-8d26ba89873a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:24.347666 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ef240f64-3718-4a9d-ab9f-8d26ba89873a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:24.348114 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ef240f64-3718-4a9d-ab9f-8d26ba89873a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:24.349515 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ef240f64-3718-4a9d-ab9f-8d26ba89873a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:24.349947 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ef240f64-3718-4a9d-ab9f-8d26ba89873a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:24.429110 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-d6f57862-d4ec-4f67-b482-471e9670a392 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:24.429739 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-d6f57862-d4ec-4f67-b482-471e9670a392 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:24.438925 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d6f57862-d4ec-4f67-b482-471e9670a392 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:24.439910 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d6f57862-d4ec-4f67-b482-471e9670a392 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:24.441288 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d6f57862-d4ec-4f67-b482-471e9670a392 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:24.442088 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d6f57862-d4ec-4f67-b482-471e9670a392 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:24.629346 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-d6f57862-d4ec-4f67-b482-471e9670a392 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:24.637852 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-d6f57862-d4ec-4f67-b482-471e9670a392 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1753 microversion: 2.1 time: 0.214689 Jul 12 17:44:24.638457 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 350/714] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:24 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1753 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:44:24.642989 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-b93efa4b-aa14-4005-8b74-5888757136b5 req-ac49872f-92c2-4b38-9ed2-e8870ac64542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ad3f97-288d-4704-ad33-35bc58e94dfe", "name": "network-vif-plugged", "status": "completed", "tag": "c8a33017-1571-46b3-8afd-ee6981b1ac07"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:44:24.659018 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-b93efa4b-aa14-4005-8b74-5888757136b5 req-ac49872f-92c2-4b38-9ed2-e8870ac64542 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:24.659939 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-b93efa4b-aa14-4005-8b74-5888757136b5 req-ac49872f-92c2-4b38-9ed2-e8870ac64542 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:24.674695 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-b93efa4b-aa14-4005-8b74-5888757136b5 req-ac49872f-92c2-4b38-9ed2-e8870ac64542 service nova] Creating event network-vif-plugged:c8a33017-1571-46b3-8afd-ee6981b1ac07 for instance 07ad3f97-288d-4704-ad33-35bc58e94dfe on hv-cinder-84875 Jul 12 17:44:24.680011 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-b93efa4b-aa14-4005-8b74-5888757136b5 req-ac49872f-92c2-4b38-9ed2-e8870ac64542 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040403 Jul 12 17:44:24.681024 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 351/715] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:44:25.058454 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-a2ca24fb-7433-4410-90a2-c4c1d74d29e7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:25.059207 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-a2ca24fb-7433-4410-90a2-c4c1d74d29e7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:25.066274 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a2ca24fb-7433-4410-90a2-c4c1d74d29e7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:25.066755 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a2ca24fb-7433-4410-90a2-c4c1d74d29e7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:25.068080 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a2ca24fb-7433-4410-90a2-c4c1d74d29e7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:25.069181 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a2ca24fb-7433-4410-90a2-c4c1d74d29e7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:25.133737 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-ef240f64-3718-4a9d-ab9f-8d26ba89873a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "POST /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.796790 Jul 12 17:44:25.135587 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 365/716] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jul 12 17:44:24 2022] POST /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f/os-volume_attachments => generated 194 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:44:25.247386 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-a2ca24fb-7433-4410-90a2-c4c1d74d29e7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:25.256386 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-a2ca24fb-7433-4410-90a2-c4c1d74d29e7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:25.257939 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-a2ca24fb-7433-4410-90a2-c4c1d74d29e7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:25.259154 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-a2ca24fb-7433-4410-90a2-c4c1d74d29e7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1406 microversion: 2.20 time: 0.205061 Jul 12 17:44:25.259717 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 352/717] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:44:25 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:44:25.659057 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell0:SELECT=2 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:44:25.659849 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell0:SELECT=6 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:44:25.665495 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-f0bfea9a-b3bb-466f-b47b-daab81d61048 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:25.666266 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-f0bfea9a-b3bb-466f-b47b-daab81d61048 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:25.672952 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f0bfea9a-b3bb-466f-b47b-daab81d61048 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:25.673404 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f0bfea9a-b3bb-466f-b47b-daab81d61048 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:25.674239 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f0bfea9a-b3bb-466f-b47b-daab81d61048 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:25.674708 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f0bfea9a-b3bb-466f-b47b-daab81d61048 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:25.837101 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-f0bfea9a-b3bb-466f-b47b-daab81d61048 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:25.845987 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-f0bfea9a-b3bb-466f-b47b-daab81d61048 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1753 microversion: 2.1 time: 0.188171 Jul 12 17:44:25.846641 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 366/718] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:25 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1753 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:26.277932 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-ecce3a22-ef5f-4fa7-a997-b43034974098 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:26.278538 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-ecce3a22-ef5f-4fa7-a997-b43034974098 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:26.280564 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell0:SELECT=6 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:44:26.286170 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ecce3a22-ef5f-4fa7-a997-b43034974098 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:26.287204 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ecce3a22-ef5f-4fa7-a997-b43034974098 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:26.287988 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ecce3a22-ef5f-4fa7-a997-b43034974098 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:26.289406 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ecce3a22-ef5f-4fa7-a997-b43034974098 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:26.435083 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ecce3a22-ef5f-4fa7-a997-b43034974098 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:26.450233 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ecce3a22-ef5f-4fa7-a997-b43034974098 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:26.453387 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ecce3a22-ef5f-4fa7-a997-b43034974098 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:26.455646 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-ecce3a22-ef5f-4fa7-a997-b43034974098 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1406 microversion: 2.20 time: 0.181424 Jul 12 17:44:26.456677 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 353/719] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:44:26 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:44:26.863841 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-b4b79fe6-311a-407f-9298-0b6274c09aa9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:26.864460 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-b4b79fe6-311a-407f-9298-0b6274c09aa9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:26.871135 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b4b79fe6-311a-407f-9298-0b6274c09aa9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:26.871603 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b4b79fe6-311a-407f-9298-0b6274c09aa9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:26.872369 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b4b79fe6-311a-407f-9298-0b6274c09aa9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:26.872809 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b4b79fe6-311a-407f-9298-0b6274c09aa9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:27.027383 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-b4b79fe6-311a-407f-9298-0b6274c09aa9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:27.035522 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-b4b79fe6-311a-407f-9298-0b6274c09aa9 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1753 microversion: 2.1 time: 0.175717 Jul 12 17:44:27.036098 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 367/720] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:26 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1753 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:27.481366 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-a7f762b8-90d1-446a-8fd8-35d14e861607 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:27.481979 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-a7f762b8-90d1-446a-8fd8-35d14e861607 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:27.488859 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a7f762b8-90d1-446a-8fd8-35d14e861607 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:27.489308 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a7f762b8-90d1-446a-8fd8-35d14e861607 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:27.490808 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a7f762b8-90d1-446a-8fd8-35d14e861607 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:27.491243 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a7f762b8-90d1-446a-8fd8-35d14e861607 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:27.626823 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-a7f762b8-90d1-446a-8fd8-35d14e861607 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:27.635938 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-a7f762b8-90d1-446a-8fd8-35d14e861607 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:27.637495 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-a7f762b8-90d1-446a-8fd8-35d14e861607 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:27.638710 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-a7f762b8-90d1-446a-8fd8-35d14e861607 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1597 microversion: 2.20 time: 0.161313 Jul 12 17:44:27.639300 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 354/721] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:44:27 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1597 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:44:27.655820 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-161c04c6-0720-406c-9766-8999d343ab32 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:27.656314 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-161c04c6-0720-406c-9766-8999d343ab32 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:27.662412 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-161c04c6-0720-406c-9766-8999d343ab32 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:27.663080 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-161c04c6-0720-406c-9766-8999d343ab32 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:27.663856 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-161c04c6-0720-406c-9766-8999d343ab32 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:27.664299 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-161c04c6-0720-406c-9766-8999d343ab32 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:27.742832 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-161c04c6-0720-406c-9766-8999d343ab32 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090817 Jul 12 17:44:27.743432 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 368/722] 10.222.0.16 () {60 vars in 1315 bytes} [Tue Jul 12 17:44:27 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:44:28.054483 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-c2fafe94-0dd2-4b59-8421-03c326ffdf2f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:28.055106 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-c2fafe94-0dd2-4b59-8421-03c326ffdf2f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:28.061088 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c2fafe94-0dd2-4b59-8421-03c326ffdf2f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:28.061548 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c2fafe94-0dd2-4b59-8421-03c326ffdf2f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:28.062298 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c2fafe94-0dd2-4b59-8421-03c326ffdf2f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:28.062763 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c2fafe94-0dd2-4b59-8421-03c326ffdf2f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:28.212362 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-f418b3f5-32ad-4ee8-9fcf-d8e6a400d15c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:28.212943 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-f418b3f5-32ad-4ee8-9fcf-d8e6a400d15c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:28.219768 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f418b3f5-32ad-4ee8-9fcf-d8e6a400d15c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:28.220306 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f418b3f5-32ad-4ee8-9fcf-d8e6a400d15c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:28.221179 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f418b3f5-32ad-4ee8-9fcf-d8e6a400d15c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:28.221747 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f418b3f5-32ad-4ee8-9fcf-d8e6a400d15c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:28.238364 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-c2fafe94-0dd2-4b59-8421-03c326ffdf2f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:28.247837 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-c2fafe94-0dd2-4b59-8421-03c326ffdf2f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1753 microversion: 2.1 time: 0.198455 Jul 12 17:44:28.248404 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 355/723] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:28 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1753 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:28.316178 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.objects.instance [None req-f418b3f5-32ad-4ee8-9fcf-d8e6a400d15c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lazy-loading 'services' on Instance uuid eab0c8cd-6093-440a-8e95-c58ede89a22b {{(pid=130059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:44:28.572989 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-f418b3f5-32ad-4ee8-9fcf-d8e6a400d15c tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b/os-volume_attachments/14fbcf4d-bab4-4646-a6b3-c9277be07fd8" status: 202 len: 0 microversion: 2.1 time: 0.368424 Jul 12 17:44:28.573923 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 369/724] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jul 12 17:44:28 2022] DELETE /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b/os-volume_attachments/14fbcf4d-bab4-4646-a6b3-c9277be07fd8 => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:44:28.585009 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-973a643f-b8f3-43c1-a7c3-13929886d748 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:28.587092 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-973a643f-b8f3-43c1-a7c3-13929886d748 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:28.594007 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-973a643f-b8f3-43c1-a7c3-13929886d748 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:28.594518 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-973a643f-b8f3-43c1-a7c3-13929886d748 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:28.599326 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-973a643f-b8f3-43c1-a7c3-13929886d748 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:28.599326 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-973a643f-b8f3-43c1-a7c3-13929886d748 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:28.636537 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-973a643f-b8f3-43c1-a7c3-13929886d748 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056496 Jul 12 17:44:28.637631 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 356/725] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:44:28 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:44:28.797307 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-dcac9bc4-3ef5-4918-aded-ebf914054ac4 req-b0b02203-26af-4dbb-817c-8c506c937623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07ad3f97-288d-4704-ad33-35bc58e94dfe", "tag": "c8a33017-1571-46b3-8afd-ee6981b1ac07"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:44:28.808221 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-dcac9bc4-3ef5-4918-aded-ebf914054ac4 req-b0b02203-26af-4dbb-817c-8c506c937623 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:28.808804 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-dcac9bc4-3ef5-4918-aded-ebf914054ac4 req-b0b02203-26af-4dbb-817c-8c506c937623 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:28.822781 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-dcac9bc4-3ef5-4918-aded-ebf914054ac4 req-b0b02203-26af-4dbb-817c-8c506c937623 service nova] Creating event network-changed:c8a33017-1571-46b3-8afd-ee6981b1ac07 for instance 07ad3f97-288d-4704-ad33-35bc58e94dfe on hv-cinder-84875 Jul 12 17:44:28.828591 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-dcac9bc4-3ef5-4918-aded-ebf914054ac4 req-b0b02203-26af-4dbb-817c-8c506c937623 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036482 Jul 12 17:44:28.829200 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 370/726] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:44:29.267460 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-4b9c8f87-1286-4057-869f-d97bcd38bdf0 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:29.268098 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-4b9c8f87-1286-4057-869f-d97bcd38bdf0 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:29.276216 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4b9c8f87-1286-4057-869f-d97bcd38bdf0 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:29.276744 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4b9c8f87-1286-4057-869f-d97bcd38bdf0 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:29.277515 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4b9c8f87-1286-4057-869f-d97bcd38bdf0 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:29.277948 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4b9c8f87-1286-4057-869f-d97bcd38bdf0 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:29.438062 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-4b9c8f87-1286-4057-869f-d97bcd38bdf0 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:29.446419 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-4b9c8f87-1286-4057-869f-d97bcd38bdf0 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1753 microversion: 2.1 time: 0.185022 Jul 12 17:44:29.447594 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 357/727] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:29 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1753 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:29.649596 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ac873c0e-816e-4c46-95e0-a9793c1176d3 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:29.650771 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-ac873c0e-816e-4c46-95e0-a9793c1176d3 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:29.658133 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ac873c0e-816e-4c46-95e0-a9793c1176d3 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:29.658646 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ac873c0e-816e-4c46-95e0-a9793c1176d3 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:29.659442 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ac873c0e-816e-4c46-95e0-a9793c1176d3 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:29.659888 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ac873c0e-816e-4c46-95e0-a9793c1176d3 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:29.695748 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-ac873c0e-816e-4c46-95e0-a9793c1176d3 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050733 Jul 12 17:44:29.696629 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 371/728] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:44:29 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:44:30.465588 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-0a3e05dd-36de-4452-87bd-c9c0b4613744 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:30.466208 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-0a3e05dd-36de-4452-87bd-c9c0b4613744 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:30.473052 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0a3e05dd-36de-4452-87bd-c9c0b4613744 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:30.473507 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0a3e05dd-36de-4452-87bd-c9c0b4613744 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:30.474605 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0a3e05dd-36de-4452-87bd-c9c0b4613744 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:30.475049 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0a3e05dd-36de-4452-87bd-c9c0b4613744 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:30.626988 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0a3e05dd-36de-4452-87bd-c9c0b4613744 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:30.636349 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-0a3e05dd-36de-4452-87bd-c9c0b4613744 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1756 microversion: 2.1 time: 0.174975 Jul 12 17:44:30.636936 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 358/729] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:30 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:30.708084 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-de729e98-2217-40f9-843e-8c5d3e69e08a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:30.709324 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-de729e98-2217-40f9-843e-8c5d3e69e08a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:30.715766 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-de729e98-2217-40f9-843e-8c5d3e69e08a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:30.716214 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-de729e98-2217-40f9-843e-8c5d3e69e08a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:30.716987 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-de729e98-2217-40f9-843e-8c5d3e69e08a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:30.717423 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-de729e98-2217-40f9-843e-8c5d3e69e08a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:30.751500 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-de729e98-2217-40f9-843e-8c5d3e69e08a tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047532 Jul 12 17:44:30.752129 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 372/730] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:44:30 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:44:31.764143 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-39150d3c-97ec-4e62-87b6-c8287e71e323 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:31.765026 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-39150d3c-97ec-4e62-87b6-c8287e71e323 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:31.772420 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-39150d3c-97ec-4e62-87b6-c8287e71e323 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:31.772889 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-39150d3c-97ec-4e62-87b6-c8287e71e323 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:31.773683 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-39150d3c-97ec-4e62-87b6-c8287e71e323 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:31.774127 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-39150d3c-97ec-4e62-87b6-c8287e71e323 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:31.802855 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-39150d3c-97ec-4e62-87b6-c8287e71e323 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042725 Jul 12 17:44:31.803409 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 359/731] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:44:31 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:44:32.815468 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-953b555f-6ef4-41d5-a7c5-fa20b0bd4ae0 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:32.816325 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-953b555f-6ef4-41d5-a7c5-fa20b0bd4ae0 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:32.824091 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-953b555f-6ef4-41d5-a7c5-fa20b0bd4ae0 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:32.824540 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-953b555f-6ef4-41d5-a7c5-fa20b0bd4ae0 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:32.825303 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-953b555f-6ef4-41d5-a7c5-fa20b0bd4ae0 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:32.825737 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-953b555f-6ef4-41d5-a7c5-fa20b0bd4ae0 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:32.859646 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-953b555f-6ef4-41d5-a7c5-fa20b0bd4ae0 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048871 Jul 12 17:44:32.860205 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 373/732] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:44:32 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:44:33.728139 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b8f56c7a-166e-45f7-9402-1b9a15bd3e97 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11ff5088-aaff-41ed-ab8c-5a82d60cd082"}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:44:33.729173 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-b8f56c7a-166e-45f7-9402-1b9a15bd3e97 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:33.731582 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:44:33.736398 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b8f56c7a-166e-45f7-9402-1b9a15bd3e97 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:33.737033 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b8f56c7a-166e-45f7-9402-1b9a15bd3e97 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:33.737619 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b8f56c7a-166e-45f7-9402-1b9a15bd3e97 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:33.738048 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b8f56c7a-166e-45f7-9402-1b9a15bd3e97 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:33.820582 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.wsgi [None req-b8f56c7a-166e-45f7-9402-1b9a15bd3e97 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] HTTP exception thrown: Invalid volume: volume 11ff5088-aaff-41ed-ab8c-5a82d60cd082 is already attached to instances: 22b53cb5-97e1-40c6-bffe-ca1132409e2f Jul 12 17:44:33.822345 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b8f56c7a-166e-45f7-9402-1b9a15bd3e97 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Request method failure captured: Jul 12 17:44:33.822345 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: request: POST /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f/os-volume_attachments HTTP/1.1 Jul 12 17:44:33.822345 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept: application/json Jul 12 17:44:33.822345 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept-Encoding: identity Jul 12 17:44:33.822345 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Connection: close Jul 12 17:44:33.822345 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Length: 74 Jul 12 17:44:33.822345 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Type: application/json Jul 12 17:44:33.822345 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Host: 10.222.0.16 Jul 12 17:44:33.822345 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Openstack-System-Scope: None Jul 12 17:44:33.822345 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: User-Agent: python-urllib3/1.26.9 Jul 12 17:44:33.822345 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Auth-Token: gAAAAABizbHIKPX81cOSzuTp0O3vMBUQ_2pscgJx1VEp1s8R65yvOz2oUKOjUaqFlJmNQdapSExRqaTx7so1aRxIG_vuYNvJ_o-Kb6m698uGIk6QmB9ep_Ed50ORq5_o-D700OCaKd2Eu3BHwptAzFT8ZMufAhu8lzyW1do401lCvRn-uiuATyM Jul 12 17:44:33.822345 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Id: None Jul 12 17:44:33.822345 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Name: None Jul 12 17:44:33.822345 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Identity-Status: Confirmed Jul 12 17:44:33.822345 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Is-Admin-Project: True Jul 12 17:44:33.822345 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Id: default Jul 12 17:44:33.822345 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Name: Default Jul 12 17:44:33.822345 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Id: 84b840eaa59d4f73ac68926437f03d82 Jul 12 17:44:33.822345 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Name: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:44:33.822345 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Role: reader,member Jul 12 17:44:33.822345 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Roles: reader,member Jul 12 17:44:33.823953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84b840eaa59d4f73ac68926437f03d82", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:44:33.823953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:44:33.823953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Id: 84b840eaa59d4f73ac68926437f03d82 Jul 12 17:44:33.823953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:44:33.823953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User: tempest-AttachVolumeNegativeTest-834922830-project Jul 12 17:44:33.823953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Id: default Jul 12 17:44:33.823953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Name: Default Jul 12 17:44:33.823953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Id: c8441a4a72154ee3bbb95af66abf2ffd Jul 12 17:44:33.823953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Name: tempest-AttachVolumeNegativeTest-834922830-project Jul 12 17:44:33.823953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Jul 12 17:44:33.823953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: {"volumeAttachment": {"volumeId": "11ff5088-aaff-41ed-ab8c-5a82d60cd082"}} Jul 12 17:44:33.823953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: method: > Jul 12 17:44:33.824802 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: exception: Invalid volume: volume 11ff5088-aaff-41ed-ab8c-5a82d60cd082 is already attached to instances: 22b53cb5-97e1-40c6-bffe-ca1132409e2f Jul 12 17:44:33.824802 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: action_args: {'server_id': '22b53cb5-97e1-40c6-bffe-ca1132409e2f', 'body': {'volumeAttachment': {'volumeId': '11ff5088-aaff-41ed-ab8c-5a82d60cd082'}}} Jul 12 17:44:33.824802 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:44:33.824802 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:44:33.824802 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 17:44:33.824802 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 17:44:33.824802 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 17:44:33.824802 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 17:44:33.824802 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 12 17:44:33.824802 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 12 17:44:33.824802 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 12 17:44:33.824802 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 12 17:44:33.824802 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 12 17:44:33.824802 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 12 17:44:33.824802 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 11ff5088-aaff-41ed-ab8c-5a82d60cd082 is already attached to instances: 22b53cb5-97e1-40c6-bffe-ca1132409e2f Jul 12 17:44:33.824802 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:44:33.824802 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:44:33.824802 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:44:33.824802 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:44:33.826032 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:44:33.826032 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:44:33.826032 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:44:33.826032 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:44:33.826032 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:44:33.826032 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:44:33.826032 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 17:44:33.826032 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 17:44:33.826032 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 17:44:33.826032 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 17:44:33.826032 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 17:44:33.826032 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 17:44:33.826032 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 12 17:44:33.826032 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 12 17:44:33.826032 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 11ff5088-aaff-41ed-ab8c-5a82d60cd082 is already attached to instances: 22b53cb5-97e1-40c6-bffe-ca1132409e2f Jul 12 17:44:33.826032 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:44:33.826032 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:44:33.826032 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:44:33.826032 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:44:33.826032 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:44:33.827500 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:44:33.827500 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:44:33.827500 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:44:33.827500 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 11ff5088-aaff-41ed-ab8c-5a82d60cd082 is already attached to instances: 22b53cb5-97e1-40c6-bffe-ca1132409e2f Jul 12 17:44:33.827500 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:44:33.827500 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b8f56c7a-166e-45f7-9402-1b9a15bd3e97 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Returning 400 to user: Invalid volume: volume 11ff5088-aaff-41ed-ab8c-5a82d60cd082 is already attached to instances: 22b53cb5-97e1-40c6-bffe-ca1132409e2f {{(pid=130058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:44:33.827500 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-b8f56c7a-166e-45f7-9402-1b9a15bd3e97 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "POST /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100506 Jul 12 17:44:33.827500 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 360/733] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jul 12 17:44:33 2022] POST /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 12 17:44:33.874512 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-726b4260-8a3b-4539-a355-0314bb3fd687 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:33.877752 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-726b4260-8a3b-4539-a355-0314bb3fd687 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:33.883813 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:44:33.889714 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-726b4260-8a3b-4539-a355-0314bb3fd687 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:33.892108 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-9337e8e5-1cfd-4a22-8519-5021b9583faf tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:33.892328 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-726b4260-8a3b-4539-a355-0314bb3fd687 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:33.892472 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-9337e8e5-1cfd-4a22-8519-5021b9583faf tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:33.892607 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-726b4260-8a3b-4539-a355-0314bb3fd687 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:33.892607 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-726b4260-8a3b-4539-a355-0314bb3fd687 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:33.898517 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9337e8e5-1cfd-4a22-8519-5021b9583faf tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:33.898973 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9337e8e5-1cfd-4a22-8519-5021b9583faf tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:33.899765 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9337e8e5-1cfd-4a22-8519-5021b9583faf tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:33.900203 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9337e8e5-1cfd-4a22-8519-5021b9583faf tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:33.927813 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-726b4260-8a3b-4539-a355-0314bb3fd687 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060286 Jul 12 17:44:33.928808 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 374/734] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:44:33 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:44:34.031836 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.objects.instance [None req-9337e8e5-1cfd-4a22-8519-5021b9583faf tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lazy-loading 'services' on Instance uuid 22b53cb5-97e1-40c6-bffe-ca1132409e2f {{(pid=130058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:44:34.431619 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-9337e8e5-1cfd-4a22-8519-5021b9583faf tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "DELETE /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f/os-volume_attachments/11ff5088-aaff-41ed-ab8c-5a82d60cd082" status: 202 len: 0 microversion: 2.1 time: 0.545360 Jul 12 17:44:34.432146 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 361/735] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jul 12 17:44:33 2022] DELETE /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f/os-volume_attachments/11ff5088-aaff-41ed-ab8c-5a82d60cd082 => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 17:44:34.442318 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-409744c2-faa9-47e5-a786-1ac24b948a1d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:34.444218 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-409744c2-faa9-47e5-a786-1ac24b948a1d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:34.450674 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-409744c2-faa9-47e5-a786-1ac24b948a1d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:34.451125 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-409744c2-faa9-47e5-a786-1ac24b948a1d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:34.451896 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-409744c2-faa9-47e5-a786-1ac24b948a1d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:34.452333 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-409744c2-faa9-47e5-a786-1ac24b948a1d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:34.483511 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-409744c2-faa9-47e5-a786-1ac24b948a1d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046683 Jul 12 17:44:34.484073 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 375/736] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:44:34 2022] GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:44:34.941901 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-27eb0ac0-2a6c-4f52-b380-492da3931bd4 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:34.943041 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-27eb0ac0-2a6c-4f52-b380-492da3931bd4 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:34.949563 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-27eb0ac0-2a6c-4f52-b380-492da3931bd4 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:34.950061 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-27eb0ac0-2a6c-4f52-b380-492da3931bd4 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:34.950892 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-27eb0ac0-2a6c-4f52-b380-492da3931bd4 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:34.951330 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-27eb0ac0-2a6c-4f52-b380-492da3931bd4 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:34.981485 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-27eb0ac0-2a6c-4f52-b380-492da3931bd4 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044576 Jul 12 17:44:34.982042 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 362/737] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:44:34 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 17:44:35.057091 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-8de8ebe9-dd84-4751-aa95-6278a570d23b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:35.057648 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-8de8ebe9-dd84-4751-aa95-6278a570d23b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:35.064441 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8de8ebe9-dd84-4751-aa95-6278a570d23b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:35.064970 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8de8ebe9-dd84-4751-aa95-6278a570d23b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:35.065847 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8de8ebe9-dd84-4751-aa95-6278a570d23b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:35.066283 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8de8ebe9-dd84-4751-aa95-6278a570d23b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:35.093794 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-8de8ebe9-dd84-4751-aa95-6278a570d23b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Going to try to terminate instance {{(pid=130059) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:44:35.207338 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:44:35.351280 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-8de8ebe9-dd84-4751-aa95-6278a570d23b tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 204 len: 0 microversion: 2.1 time: 0.298537 Jul 12 17:44:35.351865 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 376/738] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 12 17:44:35 2022] DELETE /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:44:35.359908 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-6c1b6f5a-b79a-492e-b9fb-0e30e19133e0 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:35.363185 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-6c1b6f5a-b79a-492e-b9fb-0e30e19133e0 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:35.367576 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6c1b6f5a-b79a-492e-b9fb-0e30e19133e0 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:35.368031 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6c1b6f5a-b79a-492e-b9fb-0e30e19133e0 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:35.368843 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6c1b6f5a-b79a-492e-b9fb-0e30e19133e0 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:35.369278 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6c1b6f5a-b79a-492e-b9fb-0e30e19133e0 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:35.373418 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:44:35.499683 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-3f14a403-e387-4836-843f-6edd7de6609a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:35.500821 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-3f14a403-e387-4836-843f-6edd7de6609a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:35.507178 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-6c1b6f5a-b79a-492e-b9fb-0e30e19133e0 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:35.507928 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3f14a403-e387-4836-843f-6edd7de6609a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:35.508372 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3f14a403-e387-4836-843f-6edd7de6609a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:35.509372 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3f14a403-e387-4836-843f-6edd7de6609a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:35.509833 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3f14a403-e387-4836-843f-6edd7de6609a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:35.515926 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-6c1b6f5a-b79a-492e-b9fb-0e30e19133e0 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1686 microversion: 2.1 time: 0.159899 Jul 12 17:44:35.516743 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 363/739] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:35 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:35.542733 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-3f14a403-e387-4836-843f-6edd7de6609a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048447 Jul 12 17:44:35.543364 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 377/740] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:44:35 2022] GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:44:36.532826 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-72d20f82-d078-492d-b401-18652ea0a064 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:36.539837 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-72d20f82-d078-492d-b401-18652ea0a064 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:36.540568 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-72d20f82-d078-492d-b401-18652ea0a064 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:36.541020 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-72d20f82-d078-492d-b401-18652ea0a064 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:36.541791 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-72d20f82-d078-492d-b401-18652ea0a064 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:36.542230 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-72d20f82-d078-492d-b401-18652ea0a064 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:36.555649 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-f530f8f9-e8dc-4909-aa12-cc77de7656da tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:36.556575 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-f530f8f9-e8dc-4909-aa12-cc77de7656da tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:36.563209 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f530f8f9-e8dc-4909-aa12-cc77de7656da tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:36.563664 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f530f8f9-e8dc-4909-aa12-cc77de7656da tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:36.564475 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f530f8f9-e8dc-4909-aa12-cc77de7656da tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:36.564919 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f530f8f9-e8dc-4909-aa12-cc77de7656da tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:36.597103 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-f530f8f9-e8dc-4909-aa12-cc77de7656da tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045978 Jul 12 17:44:36.597684 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 378/741] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:44:36 2022] GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:44:36.682045 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-72d20f82-d078-492d-b401-18652ea0a064 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:36.689743 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-72d20f82-d078-492d-b401-18652ea0a064 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1686 microversion: 2.1 time: 0.160877 Jul 12 17:44:36.690313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 364/742] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:36 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1686 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:37.609045 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ea4dde98-b233-43cf-8a6e-063547ca415a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:37.609969 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-ea4dde98-b233-43cf-8a6e-063547ca415a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:37.617543 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ea4dde98-b233-43cf-8a6e-063547ca415a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:37.617996 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ea4dde98-b233-43cf-8a6e-063547ca415a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:37.618809 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ea4dde98-b233-43cf-8a6e-063547ca415a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:37.619248 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ea4dde98-b233-43cf-8a6e-063547ca415a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:37.650050 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-ea4dde98-b233-43cf-8a6e-063547ca415a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044535 Jul 12 17:44:37.650899 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 379/743] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:44:37 2022] GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:44:37.707826 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-126a344b-89ca-4eaf-b549-bbb794c04742 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:37.708478 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-126a344b-89ca-4eaf-b549-bbb794c04742 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:37.715240 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-126a344b-89ca-4eaf-b549-bbb794c04742 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:37.715755 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-126a344b-89ca-4eaf-b549-bbb794c04742 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:37.716537 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-126a344b-89ca-4eaf-b549-bbb794c04742 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:37.716967 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-126a344b-89ca-4eaf-b549-bbb794c04742 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:37.851390 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-126a344b-89ca-4eaf-b549-bbb794c04742 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:37.858856 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-126a344b-89ca-4eaf-b549-bbb794c04742 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1686 microversion: 2.1 time: 0.154860 Jul 12 17:44:37.859423 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 365/744] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:37 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:38.662332 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-16316b47-d2a6-4f68-9924-ccf585f51d88 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:38.664939 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-16316b47-d2a6-4f68-9924-ccf585f51d88 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:38.670789 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-16316b47-d2a6-4f68-9924-ccf585f51d88 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:38.671243 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-16316b47-d2a6-4f68-9924-ccf585f51d88 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:38.672009 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-16316b47-d2a6-4f68-9924-ccf585f51d88 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:38.672451 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-16316b47-d2a6-4f68-9924-ccf585f51d88 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:38.702831 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-16316b47-d2a6-4f68-9924-ccf585f51d88 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045069 Jul 12 17:44:38.703399 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 380/745] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:44:38 2022] GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 17:44:38.760447 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-811982f5-a63a-40da-93b1-d58828cda3f9 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:38.760969 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-811982f5-a63a-40da-93b1-d58828cda3f9 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:38.767565 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-811982f5-a63a-40da-93b1-d58828cda3f9 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:38.768009 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-811982f5-a63a-40da-93b1-d58828cda3f9 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:38.768764 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-811982f5-a63a-40da-93b1-d58828cda3f9 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:38.769190 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-811982f5-a63a-40da-93b1-d58828cda3f9 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:38.795674 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-811982f5-a63a-40da-93b1-d58828cda3f9 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] Going to try to terminate instance {{(pid=130058) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:44:38.877811 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-8b4783b0-7f17-4e60-8744-ce877d4c06e3 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:38.878336 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-8b4783b0-7f17-4e60-8744-ce877d4c06e3 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:38.885119 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8b4783b0-7f17-4e60-8744-ce877d4c06e3 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:38.885722 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8b4783b0-7f17-4e60-8744-ce877d4c06e3 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:38.886540 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8b4783b0-7f17-4e60-8744-ce877d4c06e3 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:38.886985 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8b4783b0-7f17-4e60-8744-ce877d4c06e3 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:39.042735 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-811982f5-a63a-40da-93b1-d58828cda3f9 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "DELETE /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f" status: 204 len: 0 microversion: 2.1 time: 0.285577 Jul 12 17:44:39.043320 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 366/746] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 12 17:44:38 2022] DELETE /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:44:39.052018 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-6e9a1eff-6c25-4840-b79d-a57853cededd tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:39.052980 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-6e9a1eff-6c25-4840-b79d-a57853cededd tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:39.059279 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6e9a1eff-6c25-4840-b79d-a57853cededd tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:39.059747 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6e9a1eff-6c25-4840-b79d-a57853cededd tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:39.060536 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6e9a1eff-6c25-4840-b79d-a57853cededd tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:39.060975 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6e9a1eff-6c25-4840-b79d-a57853cededd tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:39.143556 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-8b4783b0-7f17-4e60-8744-ce877d4c06e3 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:39.152083 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-8b4783b0-7f17-4e60-8744-ce877d4c06e3 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1686 microversion: 2.1 time: 0.279013 Jul 12 17:44:39.153676 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 381/747] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:38 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1686 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:39.232467 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-6e9a1eff-6c25-4840-b79d-a57853cededd tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:39.240841 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-6e9a1eff-6c25-4840-b79d-a57853cededd tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f" status: 200 len: 1680 microversion: 2.1 time: 0.192594 Jul 12 17:44:39.241421 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 367/748] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:39 2022] GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f => generated 1680 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:44:40.169216 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-2bc6069f-2f3e-4272-be07-67a93ff77be7 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:40.169831 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-2bc6069f-2f3e-4272-be07-67a93ff77be7 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:40.178242 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2bc6069f-2f3e-4272-be07-67a93ff77be7 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:40.178743 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2bc6069f-2f3e-4272-be07-67a93ff77be7 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:40.179579 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2bc6069f-2f3e-4272-be07-67a93ff77be7 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:40.180020 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2bc6069f-2f3e-4272-be07-67a93ff77be7 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:40.251401 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-2bc6069f-2f3e-4272-be07-67a93ff77be7 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:40.261176 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-2bc6069f-2f3e-4272-be07-67a93ff77be7 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1620 microversion: 2.1 time: 0.095813 Jul 12 17:44:40.262108 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 382/749] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:40 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1620 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:44:40.266862 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-c581cb28-0e45-47dc-8859-b8c25f94fbb8 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:40.267477 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-c581cb28-0e45-47dc-8859-b8c25f94fbb8 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:40.274457 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c581cb28-0e45-47dc-8859-b8c25f94fbb8 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:40.274911 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c581cb28-0e45-47dc-8859-b8c25f94fbb8 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:40.275698 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c581cb28-0e45-47dc-8859-b8c25f94fbb8 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:40.276263 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c581cb28-0e45-47dc-8859-b8c25f94fbb8 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:40.288157 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-daa066f9-9fa4-4ef5-9553-5ccf897835df req-94dadc61-f040-4242-9d01-d22515b200d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eab0c8cd-6093-440a-8e95-c58ede89a22b", "name": "network-vif-deleted", "tag": "77716f74-a80f-4027-974a-c1c872d5c606"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:44:40.298064 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-daa066f9-9fa4-4ef5-9553-5ccf897835df req-94dadc61-f040-4242-9d01-d22515b200d6 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:40.299407 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-daa066f9-9fa4-4ef5-9553-5ccf897835df req-94dadc61-f040-4242-9d01-d22515b200d6 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:40.316878 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-daa066f9-9fa4-4ef5-9553-5ccf897835df req-94dadc61-f040-4242-9d01-d22515b200d6 service nova] Creating event network-vif-deleted:77716f74-a80f-4027-974a-c1c872d5c606 for instance eab0c8cd-6093-440a-8e95-c58ede89a22b on hv-cinder-84875 Jul 12 17:44:40.325943 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-daa066f9-9fa4-4ef5-9553-5ccf897835df req-94dadc61-f040-4242-9d01-d22515b200d6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113127 Jul 12 17:44:40.327069 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 368/750] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:44:40.439559 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-c581cb28-0e45-47dc-8859-b8c25f94fbb8 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:40.448888 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-c581cb28-0e45-47dc-8859-b8c25f94fbb8 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f" status: 200 len: 1680 microversion: 2.1 time: 0.185669 Jul 12 17:44:40.449482 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 383/751] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:40 2022] GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f => generated 1680 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:41.278757 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-56cab4e2-1da6-4b75-8934-e30a52ab2f49 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:41.279467 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-56cab4e2-1da6-4b75-8934-e30a52ab2f49 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:41.287503 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-56cab4e2-1da6-4b75-8934-e30a52ab2f49 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:41.288280 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-56cab4e2-1da6-4b75-8934-e30a52ab2f49 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:41.288941 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-56cab4e2-1da6-4b75-8934-e30a52ab2f49 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:41.289400 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-56cab4e2-1da6-4b75-8934-e30a52ab2f49 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:41.327926 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-56cab4e2-1da6-4b75-8934-e30a52ab2f49 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:41.328386 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-56cab4e2-1da6-4b75-8934-e30a52ab2f49 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:41.328845 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.objects.instance [None req-56cab4e2-1da6-4b75-8934-e30a52ab2f49 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lazy-loading 'fault' on Instance uuid eab0c8cd-6093-440a-8e95-c58ede89a22b {{(pid=130058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:44:41.390422 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-56cab4e2-1da6-4b75-8934-e30a52ab2f49 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:41.399220 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-56cab4e2-1da6-4b75-8934-e30a52ab2f49 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 200 len: 1334 microversion: 2.1 time: 0.124620 Jul 12 17:44:41.409225 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 369/752] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:41 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 1334 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:41.467817 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-baa200a3-73da-47b5-b2b7-52644262e508 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:41.468620 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-baa200a3-73da-47b5-b2b7-52644262e508 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:41.476713 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-baa200a3-73da-47b5-b2b7-52644262e508 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:41.476942 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-baa200a3-73da-47b5-b2b7-52644262e508 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:41.478538 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-baa200a3-73da-47b5-b2b7-52644262e508 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:41.479051 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-baa200a3-73da-47b5-b2b7-52644262e508 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:41.696085 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-baa200a3-73da-47b5-b2b7-52644262e508 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:41.704572 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-baa200a3-73da-47b5-b2b7-52644262e508 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f" status: 200 len: 1680 microversion: 2.1 time: 0.240651 Jul 12 17:44:41.705194 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 384/753] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:41 2022] GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f => generated 1680 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:42.357378 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-f87fd5e9-930d-485f-8458-11d2031697f5 req-15939ccd-6ed5-4894-a683-3305f31159f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b53cb5-97e1-40c6-bffe-ca1132409e2f", "name": "network-vif-deleted", "tag": "22a38997-dd58-4cc9-9178-17fe3af61539"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:44:42.366759 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-f87fd5e9-930d-485f-8458-11d2031697f5 req-15939ccd-6ed5-4894-a683-3305f31159f0 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:42.368788 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-f87fd5e9-930d-485f-8458-11d2031697f5 req-15939ccd-6ed5-4894-a683-3305f31159f0 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:42.386664 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-f87fd5e9-930d-485f-8458-11d2031697f5 req-15939ccd-6ed5-4894-a683-3305f31159f0 service nova] Creating event network-vif-deleted:22a38997-dd58-4cc9-9178-17fe3af61539 for instance 22b53cb5-97e1-40c6-bffe-ca1132409e2f on hv-cinder-84875 Jul 12 17:44:42.392883 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-f87fd5e9-930d-485f-8458-11d2031697f5 req-15939ccd-6ed5-4894-a683-3305f31159f0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039088 Jul 12 17:44:42.393496 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 370/754] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:44:42.416729 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-090528ac-0c30-4184-9b66-ebdb7e11f243 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:42.417344 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-090528ac-0c30-4184-9b66-ebdb7e11f243 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: eab0c8cd-6093-440a-8e95-c58ede89a22b] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:42.423928 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-090528ac-0c30-4184-9b66-ebdb7e11f243 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:42.424377 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-090528ac-0c30-4184-9b66-ebdb7e11f243 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:42.425159 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-090528ac-0c30-4184-9b66-ebdb7e11f243 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:42.425594 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-090528ac-0c30-4184-9b66-ebdb7e11f243 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:42.441436 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-090528ac-0c30-4184-9b66-ebdb7e11f243 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] HTTP exception thrown: Instance eab0c8cd-6093-440a-8e95-c58ede89a22b could not be found. Jul 12 17:44:42.443624 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-090528ac-0c30-4184-9b66-ebdb7e11f243 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Request method failure captured: Jul 12 17:44:42.443624 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b HTTP/1.1 Jul 12 17:44:42.443624 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:44:42.443624 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:44:42.443624 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:44:42.443624 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 0 Jul 12 17:44:42.443624 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:44:42.443624 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:44:42.443624 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:44:42.443624 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:44:42.443624 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbHBn2P0AAPTeyjvRqGGm6Weg8HxPH-97n_6a8wVovT5QO-_rMGfsCxsgiu9EaBIW-KFncOPHrJH7Qnqsze2YkwIJvtmH_T_TgjuioF1uYFHDL21pP5xK7Y-mYfYQH4WSfEr_stqyIxKbKplZI_fQ0LBE7l4xFC8cVH7u9H_iS3Qd18 Jul 12 17:44:42.443624 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:44:42.443624 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:44:42.443624 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:44:42.443624 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:44:42.443624 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:44:42.443624 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:44:42.443624 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: 497c73f9a78743e9b24b2b6ff47d7ede Jul 12 17:44:42.443624 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-151557955 Jul 12 17:44:42.443624 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:44:42.443624 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:44:42.446199 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/497c73f9a78743e9b24b2b6ff47d7ede"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_497c73f9a78743e9b24b2b6ff47d7ede", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/497c73f9a78743e9b24b2b6ff47d7ede"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/497c73f9a78743e9b24b2b6ff47d7ede"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:44:42.446199 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-ServerRescueNegativeTestJSON-151557955 Jul 12 17:44:42.446199 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: 497c73f9a78743e9b24b2b6ff47d7ede Jul 12 17:44:42.446199 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-151557955 Jul 12 17:44:42.446199 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-ServerRescueNegativeTestJSON-151557955-project Jul 12 17:44:42.446199 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:44:42.446199 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:44:42.446199 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: ce09df98c929416e8ca67b0728349bfb Jul 12 17:44:42.446199 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-ServerRescueNegativeTestJSON-151557955-project Jul 12 17:44:42.446199 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: > Jul 12 17:44:42.446199 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Instance eab0c8cd-6093-440a-8e95-c58ede89a22b could not be found. Jul 12 17:44:42.446199 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'id': 'eab0c8cd-6093-440a-8e95-c58ede89a22b'} Jul 12 17:44:42.447006 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:44:42.447006 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:44:42.447006 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:44:42.447006 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:44:42.447006 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:44:42.447006 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:44:42.447006 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:44:42.447006 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:44:42.447006 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:44:42.447006 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:44:42.447006 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eab0c8cd-6093-440a-8e95-c58ede89a22b could not be found. Jul 12 17:44:42.447006 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:44:42.447006 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:44:42.447006 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:44:42.447006 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:44:42.447006 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:44:42.447006 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:44:42.447006 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:44:42.447006 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:44:42.447006 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:44:42.448255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:44:42.448255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:44:42.448255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:44:42.448255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:44:42.448255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:44:42.448255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:44:42.448255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:44:42.448255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eab0c8cd-6093-440a-8e95-c58ede89a22b could not be found. Jul 12 17:44:42.448255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:44:42.448255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:44:42.448255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:44:42.448255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:44:42.448255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:44:42.448255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:44:42.448255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:44:42.448255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:44:42.448255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eab0c8cd-6093-440a-8e95-c58ede89a22b could not be found. Jul 12 17:44:42.448255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:44:42.449354 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-090528ac-0c30-4184-9b66-ebdb7e11f243 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Returning 404 to user: Instance eab0c8cd-6093-440a-8e95-c58ede89a22b could not be found. {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:44:42.449354 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-090528ac-0c30-4184-9b66-ebdb7e11f243 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b" status: 404 len: 111 microversion: 2.1 time: 0.032465 Jul 12 17:44:42.449354 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 385/755] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:42 2022] GET /compute/v2.1/servers/eab0c8cd-6093-440a-8e95-c58ede89a22b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:44:42.455313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-ca5588fc-e070-4447-8c15-e28639c0bd30 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '.version_select at 0x7f479fc30430>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:42.547264 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-ca5588fc-e070-4447-8c15-e28639c0bd30 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1052461520" status: 202 len: 0 microversion: 2.1 time: 0.096233 Jul 12 17:44:42.547853 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 371/756] 10.222.0.16 () {58 vars in 1220 bytes} [Tue Jul 12 17:44:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1052461520 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:44:42.722911 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-cc02bf95-9c88-4e3b-ad27-a2323c87191a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:42.723510 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-cc02bf95-9c88-4e3b-ad27-a2323c87191a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:42.732827 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cc02bf95-9c88-4e3b-ad27-a2323c87191a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:42.733683 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cc02bf95-9c88-4e3b-ad27-a2323c87191a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:42.734936 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cc02bf95-9c88-4e3b-ad27-a2323c87191a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:42.735384 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cc02bf95-9c88-4e3b-ad27-a2323c87191a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:42.774761 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cc02bf95-9c88-4e3b-ad27-a2323c87191a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:42.775440 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cc02bf95-9c88-4e3b-ad27-a2323c87191a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:42.776065 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.objects.instance [None req-cc02bf95-9c88-4e3b-ad27-a2323c87191a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lazy-loading 'fault' on Instance uuid 22b53cb5-97e1-40c6-bffe-ca1132409e2f {{(pid=130059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:44:42.850501 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-cc02bf95-9c88-4e3b-ad27-a2323c87191a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:42.860436 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-cc02bf95-9c88-4e3b-ad27-a2323c87191a tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f" status: 200 len: 1332 microversion: 2.1 time: 0.140145 Jul 12 17:44:42.867729 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 386/757] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:42 2022] GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f => generated 1332 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:43.877334 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-5a6ecec9-2dee-4fdd-8684-100c87f3590d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:43.877980 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-5a6ecec9-2dee-4fdd-8684-100c87f3590d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:43.885789 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5a6ecec9-2dee-4fdd-8684-100c87f3590d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:43.886157 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5a6ecec9-2dee-4fdd-8684-100c87f3590d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:43.886956 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5a6ecec9-2dee-4fdd-8684-100c87f3590d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:43.887397 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5a6ecec9-2dee-4fdd-8684-100c87f3590d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:43.902055 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.wsgi [None req-5a6ecec9-2dee-4fdd-8684-100c87f3590d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] HTTP exception thrown: Instance 22b53cb5-97e1-40c6-bffe-ca1132409e2f could not be found. Jul 12 17:44:43.903775 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-5a6ecec9-2dee-4fdd-8684-100c87f3590d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Request method failure captured: Jul 12 17:44:43.903775 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: request: GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f HTTP/1.1 Jul 12 17:44:43.903775 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept: application/json Jul 12 17:44:43.903775 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept-Encoding: identity Jul 12 17:44:43.903775 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Connection: close Jul 12 17:44:43.903775 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Length: 0 Jul 12 17:44:43.903775 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Type: application/json Jul 12 17:44:43.903775 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Host: 10.222.0.16 Jul 12 17:44:43.903775 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Openstack-System-Scope: None Jul 12 17:44:43.903775 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: User-Agent: python-urllib3/1.26.9 Jul 12 17:44:43.903775 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Auth-Token: gAAAAABizbHIKPX81cOSzuTp0O3vMBUQ_2pscgJx1VEp1s8R65yvOz2oUKOjUaqFlJmNQdapSExRqaTx7so1aRxIG_vuYNvJ_o-Kb6m698uGIk6QmB9ep_Ed50ORq5_o-D700OCaKd2Eu3BHwptAzFT8ZMufAhu8lzyW1do401lCvRn-uiuATyM Jul 12 17:44:43.903775 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Id: None Jul 12 17:44:43.903775 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Name: None Jul 12 17:44:43.903775 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Identity-Status: Confirmed Jul 12 17:44:43.903775 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Is-Admin-Project: True Jul 12 17:44:43.903775 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Id: default Jul 12 17:44:43.903775 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Name: Default Jul 12 17:44:43.903775 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Id: 84b840eaa59d4f73ac68926437f03d82 Jul 12 17:44:43.903775 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Name: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:44:43.903775 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Role: reader,member Jul 12 17:44:43.903775 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Roles: reader,member Jul 12 17:44:43.905293 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84b840eaa59d4f73ac68926437f03d82", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:44:43.905293 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:44:43.905293 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Id: 84b840eaa59d4f73ac68926437f03d82 Jul 12 17:44:43.905293 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:44:43.905293 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User: tempest-AttachVolumeNegativeTest-834922830-project Jul 12 17:44:43.905293 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Id: default Jul 12 17:44:43.905293 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Name: Default Jul 12 17:44:43.905293 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Id: c8441a4a72154ee3bbb95af66abf2ffd Jul 12 17:44:43.905293 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Name: tempest-AttachVolumeNegativeTest-834922830-project Jul 12 17:44:43.905293 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: method: > Jul 12 17:44:43.905293 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: exception: Instance 22b53cb5-97e1-40c6-bffe-ca1132409e2f could not be found. Jul 12 17:44:43.905293 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: action_args: {'id': '22b53cb5-97e1-40c6-bffe-ca1132409e2f'} Jul 12 17:44:43.906207 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:44:43.906207 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:44:43.906207 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:44:43.906207 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:44:43.906207 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:44:43.906207 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:44:43.906207 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:44:43.906207 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:44:43.906207 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:44:43.906207 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:44:43.906207 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22b53cb5-97e1-40c6-bffe-ca1132409e2f could not be found. Jul 12 17:44:43.906207 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:44:43.906207 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:44:43.906207 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:44:43.906207 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:44:43.906207 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:44:43.906207 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:44:43.906207 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:44:43.906207 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:44:43.906207 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:44:43.907703 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:44:43.907703 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:44:43.907703 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:44:43.907703 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:44:43.907703 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:44:43.907703 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:44:43.907703 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:44:43.907703 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22b53cb5-97e1-40c6-bffe-ca1132409e2f could not be found. Jul 12 17:44:43.907703 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:44:43.907703 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:44:43.907703 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:44:43.907703 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:44:43.907703 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:44:43.907703 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:44:43.907703 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:44:43.907703 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:44:43.907703 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22b53cb5-97e1-40c6-bffe-ca1132409e2f could not be found. Jul 12 17:44:43.907703 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:44:43.909021 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-5a6ecec9-2dee-4fdd-8684-100c87f3590d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Returning 404 to user: Instance 22b53cb5-97e1-40c6-bffe-ca1132409e2f could not be found. {{(pid=130058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:44:43.909021 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-5a6ecec9-2dee-4fdd-8684-100c87f3590d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f" status: 404 len: 111 microversion: 2.1 time: 0.031888 Jul 12 17:44:43.909021 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 372/758] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:43 2022] GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:44:43.914803 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-4c1a6cef-772e-41bb-86ef-cc570c42942d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '.version_select at 0x7f479fc96670>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:43.987570 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-4c1a6cef-772e-41bb-86ef-cc570c42942d tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1691053878" status: 202 len: 0 microversion: 2.1 time: 0.076810 Jul 12 17:44:43.988285 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 387/759] 10.222.0.16 () {58 vars in 1220 bytes} [Tue Jul 12 17:44:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1691053878 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:44:44.844624 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-7e55ad26-ab1b-4be7-812f-23d00d562f76 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Action: 'create', calling method: .version_select at 0x7f479fb561f0>, body: {"keypair": {"name": "tempest-keypair-1332782440", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByj41z7yLugu7S29ftVHrbaEG0dXYEpSAsEs871ja/WxLBpD3wiH+8XqIUe8GKRZw221Db59MFyqzby+pSPbYdgtUjTvegBLIfofI7PF2EV2baWB3MvBsA0udxqfT+Z2w=="}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:44:44.859994 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-7e55ad26-ab1b-4be7-812f-23d00d562f76 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Getting quotas for project 84b840eaa59d4f73ac68926437f03d82. Resources: {'key_pairs'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:44:44.863936 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-7e55ad26-ab1b-4be7-812f-23d00d562f76 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Getting quotas for user c8441a4a72154ee3bbb95af66abf2ffd and project 84b840eaa59d4f73ac68926437f03d82. Resources: {'key_pairs'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:44:44.970267 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-7e55ad26-ab1b-4be7-812f-23d00d562f76 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.129925 Jul 12 17:44:44.971032 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 373/760] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Jul 12 17:44:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:44:45.998663 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-30a24a64-e32d-4720-b8a2-7fd91a7898eb tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:45.999254 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-30a24a64-e32d-4720-b8a2-7fd91a7898eb tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:46.005302 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-30a24a64-e32d-4720-b8a2-7fd91a7898eb tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:46.005860 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-30a24a64-e32d-4720-b8a2-7fd91a7898eb tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:46.006693 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-30a24a64-e32d-4720-b8a2-7fd91a7898eb tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:46.007146 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-30a24a64-e32d-4720-b8a2-7fd91a7898eb tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:46.040909 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-30a24a64-e32d-4720-b8a2-7fd91a7898eb tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Going to try to terminate instance {{(pid=130059) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:44:46.381005 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-30a24a64-e32d-4720-b8a2-7fd91a7898eb tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 204 len: 0 microversion: 2.1 time: 0.386458 Jul 12 17:44:46.381861 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 388/761] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 12 17:44:45 2022] DELETE /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 17:44:46.390454 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-0b9e6604-f4f0-4341-b18e-c9920fec5c28 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:46.391117 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-0b9e6604-f4f0-4341-b18e-c9920fec5c28 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:46.398951 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0b9e6604-f4f0-4341-b18e-c9920fec5c28 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:46.399402 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0b9e6604-f4f0-4341-b18e-c9920fec5c28 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:46.400177 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0b9e6604-f4f0-4341-b18e-c9920fec5c28 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:46.400609 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0b9e6604-f4f0-4341-b18e-c9920fec5c28 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:46.555819 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0b9e6604-f4f0-4341-b18e-c9920fec5c28 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:46.563859 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-0b9e6604-f4f0-4341-b18e-c9920fec5c28 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1507 microversion: 2.1 time: 0.177828 Jul 12 17:44:46.564662 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 374/762] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:46 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1507 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:47.402904 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-2698d71e-74dc-4c4e-b8b7-721b34c32488 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-794952170", "imageRef": "cb077f42-97cd-41cf-8758-764c562534f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "788020f8-05a4-4c17-a8ec-9f084f5359c6"}], "security_groups": [{"name": "tempest-securitygroup--1355502631"}], "key_name": "tempest-keypair-1332782440", "user_data": "}} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:44:47.511725 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.network.neutron [None req-2698d71e-74dc-4c4e-b8b7-721b34c32488 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] validate_networks() for [('788020f8-05a4-4c17-a8ec-9f084f5359c6', None, None, None, None, None)] {{(pid=130059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:44:47.582226 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-f14f1cfd-41d8-4b93-b52f-4e7f7eadd2c1 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:47.582949 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-f14f1cfd-41d8-4b93-b52f-4e7f7eadd2c1 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:47.588925 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f14f1cfd-41d8-4b93-b52f-4e7f7eadd2c1 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:47.589522 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f14f1cfd-41d8-4b93-b52f-4e7f7eadd2c1 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:47.590302 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f14f1cfd-41d8-4b93-b52f-4e7f7eadd2c1 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:47.590783 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f14f1cfd-41d8-4b93-b52f-4e7f7eadd2c1 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:47.734028 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-f14f1cfd-41d8-4b93-b52f-4e7f7eadd2c1 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:47.742195 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-f14f1cfd-41d8-4b93-b52f-4e7f7eadd2c1 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1507 microversion: 2.1 time: 0.164371 Jul 12 17:44:47.742869 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 375/763] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:47 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:47.959266 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-2698d71e-74dc-4c4e-b8b7-721b34c32488 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Flavor limits 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:44:47.959748 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-2698d71e-74dc-4c4e-b8b7-721b34c32488 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Image limits 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:44:47.960286 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-2698d71e-74dc-4c4e-b8b7-721b34c32488 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Flavor pref 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:44:47.960741 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-2698d71e-74dc-4c4e-b8b7-721b34c32488 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Image pref 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:44:47.961185 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-2698d71e-74dc-4c4e-b8b7-721b34c32488 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:44:47.970617 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2698d71e-74dc-4c4e-b8b7-721b34c32488 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:47.971089 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2698d71e-74dc-4c4e-b8b7-721b34c32488 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:47.971881 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2698d71e-74dc-4c4e-b8b7-721b34c32488 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:47.972316 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2698d71e-74dc-4c4e-b8b7-721b34c32488 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:47.989904 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.quota [None req-2698d71e-74dc-4c4e-b8b7-721b34c32488 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Getting quotas for project 84b840eaa59d4f73ac68926437f03d82. Resources: {'cores', 'instances', 'ram'} {{(pid=130059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:44:47.993916 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.quota [None req-2698d71e-74dc-4c4e-b8b7-721b34c32488 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Getting quotas for user c8441a4a72154ee3bbb95af66abf2ffd and project 84b840eaa59d4f73ac68926437f03d82. Resources: {'cores', 'instances', 'ram'} {{(pid=130059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:44:48.005132 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-2698d71e-74dc-4c4e-b8b7-721b34c32488 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Going to run 1 instances... {{(pid=130059) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:44:48.007709 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-2698d71e-74dc-4c4e-b8b7-721b34c32488 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: c0090e22-9f29-42b1-880a-3c7f2ef84895] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb077f42-97cd-41cf-8758-764c562534f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:44:48.165278 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-2698d71e-74dc-4c4e-b8b7-721b34c32488 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.766955 Jul 12 17:44:48.166143 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 389/764] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 12 17:44:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:44:48.176301 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-668d3266-0496-407b-8035-b28d4e5cb48e tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:48.176906 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-668d3266-0496-407b-8035-b28d4e5cb48e tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: c0090e22-9f29-42b1-880a-3c7f2ef84895] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:48.236912 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-668d3266-0496-407b-8035-b28d4e5cb48e tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:48.244241 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-668d3266-0496-407b-8035-b28d4e5cb48e tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895" status: 200 len: 1241 microversion: 2.1 time: 0.071761 Jul 12 17:44:48.244831 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 376/765] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:48 2022] GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:48.759618 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-afe84c38-9c73-4ad6-8a4f-3196d16f9317 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:48.760218 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-afe84c38-9c73-4ad6-8a4f-3196d16f9317 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:48.768051 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-afe84c38-9c73-4ad6-8a4f-3196d16f9317 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:48.768502 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-afe84c38-9c73-4ad6-8a4f-3196d16f9317 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:48.769288 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-afe84c38-9c73-4ad6-8a4f-3196d16f9317 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:48.769731 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-afe84c38-9c73-4ad6-8a4f-3196d16f9317 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:48.970775 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-afe84c38-9c73-4ad6-8a4f-3196d16f9317 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:48.979090 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-afe84c38-9c73-4ad6-8a4f-3196d16f9317 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1507 microversion: 2.1 time: 0.224389 Jul 12 17:44:48.979680 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 390/766] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:48 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1507 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:49.172513 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-2fdfe969-d056-4972-9b74-2b5fd4a672f5 req-d326a61f-e6a1-4b4c-a458-15f1b10b7020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64", "name": "network-vif-deleted", "tag": "1ff07e21-5b8b-4e11-aaf6-3fff31f7dbba"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:44:49.183181 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-2fdfe969-d056-4972-9b74-2b5fd4a672f5 req-d326a61f-e6a1-4b4c-a458-15f1b10b7020 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:49.183772 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-2fdfe969-d056-4972-9b74-2b5fd4a672f5 req-d326a61f-e6a1-4b4c-a458-15f1b10b7020 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:49.195709 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-2fdfe969-d056-4972-9b74-2b5fd4a672f5 req-d326a61f-e6a1-4b4c-a458-15f1b10b7020 service nova] Creating event network-vif-deleted:1ff07e21-5b8b-4e11-aaf6-3fff31f7dbba for instance 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 on hv-cinder-84875 Jul 12 17:44:49.200873 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-2fdfe969-d056-4972-9b74-2b5fd4a672f5 req-d326a61f-e6a1-4b4c-a458-15f1b10b7020 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032623 Jul 12 17:44:49.201590 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 377/767] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:44:49.271822 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-c5026cb2-86ab-4171-a50d-85649b224194 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:49.272526 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-c5026cb2-86ab-4171-a50d-85649b224194 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: c0090e22-9f29-42b1-880a-3c7f2ef84895] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:49.279575 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c5026cb2-86ab-4171-a50d-85649b224194 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:49.280032 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c5026cb2-86ab-4171-a50d-85649b224194 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:49.281026 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c5026cb2-86ab-4171-a50d-85649b224194 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:49.281474 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c5026cb2-86ab-4171-a50d-85649b224194 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:49.360392 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-c5026cb2-86ab-4171-a50d-85649b224194 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:49.368809 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-c5026cb2-86ab-4171-a50d-85649b224194 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895" status: 200 len: 1245 microversion: 2.1 time: 0.101702 Jul 12 17:44:49.369295 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 391/768] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:49 2022] GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895 => generated 1245 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:49.997969 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-d9cacf5d-7954-42ed-80a9-7b6e789b68a8 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:49.998709 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-d9cacf5d-7954-42ed-80a9-7b6e789b68a8 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:50.006072 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d9cacf5d-7954-42ed-80a9-7b6e789b68a8 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:50.006553 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d9cacf5d-7954-42ed-80a9-7b6e789b68a8 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:50.007508 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d9cacf5d-7954-42ed-80a9-7b6e789b68a8 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:50.007950 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d9cacf5d-7954-42ed-80a9-7b6e789b68a8 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:50.043304 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d9cacf5d-7954-42ed-80a9-7b6e789b68a8 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:50.043754 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d9cacf5d-7954-42ed-80a9-7b6e789b68a8 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:50.044217 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.objects.instance [None req-d9cacf5d-7954-42ed-80a9-7b6e789b68a8 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lazy-loading 'fault' on Instance uuid 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 {{(pid=130058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:44:50.090814 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-d9cacf5d-7954-42ed-80a9-7b6e789b68a8 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:50.098926 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-d9cacf5d-7954-42ed-80a9-7b6e789b68a8 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 200 len: 1311 microversion: 2.1 time: 0.106098 Jul 12 17:44:50.099822 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 378/769] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:49 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 1311 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:50.386541 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-420b8423-5881-4a2d-b4d0-c6fd2078682b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:50.387137 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-420b8423-5881-4a2d-b4d0-c6fd2078682b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: c0090e22-9f29-42b1-880a-3c7f2ef84895] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:50.393476 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-420b8423-5881-4a2d-b4d0-c6fd2078682b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:50.393978 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-420b8423-5881-4a2d-b4d0-c6fd2078682b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:50.394823 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-420b8423-5881-4a2d-b4d0-c6fd2078682b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:50.395263 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-420b8423-5881-4a2d-b4d0-c6fd2078682b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:50.464543 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-420b8423-5881-4a2d-b4d0-c6fd2078682b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:50.477801 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-420b8423-5881-4a2d-b4d0-c6fd2078682b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895" status: 200 len: 1293 microversion: 2.1 time: 0.095316 Jul 12 17:44:50.478880 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 392/770] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:50 2022] GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895 => generated 1293 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:44:51.117567 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-661c2def-2a5f-43a9-a59a-12dba82f4e5e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:51.118700 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-661c2def-2a5f-43a9-a59a-12dba82f4e5e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:51.125562 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-661c2def-2a5f-43a9-a59a-12dba82f4e5e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:51.126037 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-661c2def-2a5f-43a9-a59a-12dba82f4e5e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:51.126834 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-661c2def-2a5f-43a9-a59a-12dba82f4e5e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:51.127275 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-661c2def-2a5f-43a9-a59a-12dba82f4e5e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:51.142019 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.wsgi [None req-661c2def-2a5f-43a9-a59a-12dba82f4e5e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] HTTP exception thrown: Instance 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 could not be found. Jul 12 17:44:51.143825 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-661c2def-2a5f-43a9-a59a-12dba82f4e5e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Request method failure captured: Jul 12 17:44:51.143825 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: request: GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 HTTP/1.1 Jul 12 17:44:51.143825 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept: application/json Jul 12 17:44:51.143825 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept-Encoding: identity Jul 12 17:44:51.143825 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Connection: close Jul 12 17:44:51.143825 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Length: 0 Jul 12 17:44:51.143825 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Type: application/json Jul 12 17:44:51.143825 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Host: 10.222.0.16 Jul 12 17:44:51.143825 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Openstack-System-Scope: None Jul 12 17:44:51.143825 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: User-Agent: python-urllib3/1.26.9 Jul 12 17:44:51.143825 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Auth-Token: gAAAAABizbHBn2P0AAPTeyjvRqGGm6Weg8HxPH-97n_6a8wVovT5QO-_rMGfsCxsgiu9EaBIW-KFncOPHrJH7Qnqsze2YkwIJvtmH_T_TgjuioF1uYFHDL21pP5xK7Y-mYfYQH4WSfEr_stqyIxKbKplZI_fQ0LBE7l4xFC8cVH7u9H_iS3Qd18 Jul 12 17:44:51.143825 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Id: None Jul 12 17:44:51.143825 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Name: None Jul 12 17:44:51.143825 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Identity-Status: Confirmed Jul 12 17:44:51.143825 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Is-Admin-Project: True Jul 12 17:44:51.143825 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Id: default Jul 12 17:44:51.143825 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Name: Default Jul 12 17:44:51.143825 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Id: 497c73f9a78743e9b24b2b6ff47d7ede Jul 12 17:44:51.143825 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-151557955 Jul 12 17:44:51.143825 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Role: reader,member Jul 12 17:44:51.143825 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Roles: reader,member Jul 12 17:44:51.150322 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/497c73f9a78743e9b24b2b6ff47d7ede"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_497c73f9a78743e9b24b2b6ff47d7ede", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/497c73f9a78743e9b24b2b6ff47d7ede"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/497c73f9a78743e9b24b2b6ff47d7ede"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:44:51.150322 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant: tempest-ServerRescueNegativeTestJSON-151557955 Jul 12 17:44:51.150322 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Id: 497c73f9a78743e9b24b2b6ff47d7ede Jul 12 17:44:51.150322 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-151557955 Jul 12 17:44:51.150322 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User: tempest-ServerRescueNegativeTestJSON-151557955-project Jul 12 17:44:51.150322 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Id: default Jul 12 17:44:51.150322 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Name: Default Jul 12 17:44:51.150322 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Id: ce09df98c929416e8ca67b0728349bfb Jul 12 17:44:51.150322 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Name: tempest-ServerRescueNegativeTestJSON-151557955-project Jul 12 17:44:51.150322 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: method: > Jul 12 17:44:51.150322 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: exception: Instance 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 could not be found. Jul 12 17:44:51.150322 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: action_args: {'id': '8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64'} Jul 12 17:44:51.151333 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:44:51.151333 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:44:51.151333 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:44:51.151333 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:44:51.151333 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:44:51.151333 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:44:51.151333 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:44:51.151333 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:44:51.151333 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:44:51.151333 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:44:51.151333 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 could not be found. Jul 12 17:44:51.151333 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:44:51.151333 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:44:51.151333 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:44:51.151333 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:44:51.151333 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:44:51.151333 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:44:51.151333 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:44:51.151333 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:44:51.151333 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:44:51.152653 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:44:51.152653 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:44:51.152653 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:44:51.152653 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:44:51.152653 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:44:51.152653 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:44:51.152653 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:44:51.152653 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 could not be found. Jul 12 17:44:51.152653 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:44:51.152653 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:44:51.152653 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:44:51.152653 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:44:51.152653 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:44:51.152653 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:44:51.152653 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:44:51.152653 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:44:51.152653 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 could not be found. Jul 12 17:44:51.152653 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:44:51.153885 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-661c2def-2a5f-43a9-a59a-12dba82f4e5e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Returning 404 to user: Instance 8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 could not be found. {{(pid=130058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:44:51.153885 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-661c2def-2a5f-43a9-a59a-12dba82f4e5e tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64" status: 404 len: 111 microversion: 2.1 time: 0.032336 Jul 12 17:44:51.153885 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 379/771] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:51 2022] GET /compute/v2.1/servers/8f89ce3e-67bc-4d2c-9b1b-2d2b2ce2fa64 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:44:51.161408 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-e6f00edc-8d8a-436f-b6c1-308724dfb792 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:51.166720 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-e6f00edc-8d8a-436f-b6c1-308724dfb792 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:51.171025 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e6f00edc-8d8a-436f-b6c1-308724dfb792 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:51.171522 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e6f00edc-8d8a-436f-b6c1-308724dfb792 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:51.172696 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e6f00edc-8d8a-436f-b6c1-308724dfb792 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:51.173950 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e6f00edc-8d8a-436f-b6c1-308724dfb792 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:51.202458 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-e6f00edc-8d8a-436f-b6c1-308724dfb792 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Going to try to terminate instance {{(pid=130059) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:44:51.206303 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:44:51.494869 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-e6f00edc-8d8a-436f-b6c1-308724dfb792 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 204 len: 0 microversion: 2.1 time: 0.341166 Jul 12 17:44:51.495686 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 393/772] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 12 17:44:51 2022] DELETE /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:44:51.506374 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-2c5a404d-5e19-4bf8-ae12-ef01359b3405 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:51.507526 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-2c5a404d-5e19-4bf8-ae12-ef01359b3405 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: c0090e22-9f29-42b1-880a-3c7f2ef84895] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:51.518723 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-de762d7f-0dfd-4d6c-85bc-e918ea90f637 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:51.519571 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-de762d7f-0dfd-4d6c-85bc-e918ea90f637 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:51.525843 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2c5a404d-5e19-4bf8-ae12-ef01359b3405 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:51.527935 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2c5a404d-5e19-4bf8-ae12-ef01359b3405 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:51.527935 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2c5a404d-5e19-4bf8-ae12-ef01359b3405 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:51.527935 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2c5a404d-5e19-4bf8-ae12-ef01359b3405 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:51.529793 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-de762d7f-0dfd-4d6c-85bc-e918ea90f637 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:51.530253 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-de762d7f-0dfd-4d6c-85bc-e918ea90f637 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:51.531192 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-de762d7f-0dfd-4d6c-85bc-e918ea90f637 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:51.533327 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-de762d7f-0dfd-4d6c-85bc-e918ea90f637 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:51.606464 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-2c5a404d-5e19-4bf8-ae12-ef01359b3405 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:51.614267 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-2c5a404d-5e19-4bf8-ae12-ef01359b3405 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895" status: 200 len: 1299 microversion: 2.1 time: 0.114300 Jul 12 17:44:51.614886 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 380/773] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:51 2022] GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895 => generated 1299 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:51.748043 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-de762d7f-0dfd-4d6c-85bc-e918ea90f637 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:51.755581 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-de762d7f-0dfd-4d6c-85bc-e918ea90f637 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1522 microversion: 2.1 time: 0.242337 Jul 12 17:44:51.756189 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 394/774] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:51 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:52.633922 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-ef9c3029-cea0-49c3-8117-bd20c5e9ebb2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:52.634560 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-ef9c3029-cea0-49c3-8117-bd20c5e9ebb2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: c0090e22-9f29-42b1-880a-3c7f2ef84895] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:52.641276 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ef9c3029-cea0-49c3-8117-bd20c5e9ebb2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:52.641732 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ef9c3029-cea0-49c3-8117-bd20c5e9ebb2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:52.642536 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ef9c3029-cea0-49c3-8117-bd20c5e9ebb2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:52.642984 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ef9c3029-cea0-49c3-8117-bd20c5e9ebb2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:52.774130 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-f38a0011-1560-4420-88a6-648e4fbeb301 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:52.774805 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-f38a0011-1560-4420-88a6-648e4fbeb301 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:52.778330 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ef9c3029-cea0-49c3-8117-bd20c5e9ebb2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:52.781515 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f38a0011-1560-4420-88a6-648e4fbeb301 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:52.781976 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f38a0011-1560-4420-88a6-648e4fbeb301 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:52.782789 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f38a0011-1560-4420-88a6-648e4fbeb301 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:52.783232 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f38a0011-1560-4420-88a6-648e4fbeb301 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:52.788228 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-ef9c3029-cea0-49c3-8117-bd20c5e9ebb2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895" status: 200 len: 1367 microversion: 2.1 time: 0.156280 Jul 12 17:44:52.788228 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 381/775] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:52 2022] GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:52.917709 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-f38a0011-1560-4420-88a6-648e4fbeb301 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:52.932100 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-f38a0011-1560-4420-88a6-648e4fbeb301 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1522 microversion: 2.1 time: 0.162400 Jul 12 17:44:52.932725 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 395/776] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:52 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:44:53.803041 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-61ca80a2-9ee7-46c8-9da2-b53e346a89cc tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:53.803814 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-61ca80a2-9ee7-46c8-9da2-b53e346a89cc tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: c0090e22-9f29-42b1-880a-3c7f2ef84895] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:53.810351 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-61ca80a2-9ee7-46c8-9da2-b53e346a89cc tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:53.810827 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-61ca80a2-9ee7-46c8-9da2-b53e346a89cc tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:53.811586 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-61ca80a2-9ee7-46c8-9da2-b53e346a89cc tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:53.812023 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-61ca80a2-9ee7-46c8-9da2-b53e346a89cc tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:53.944997 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-61ca80a2-9ee7-46c8-9da2-b53e346a89cc tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:53.949165 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-04985953-8620-4d8a-a461-85969fdc48a1 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:53.949779 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-04985953-8620-4d8a-a461-85969fdc48a1 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:53.953173 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-61ca80a2-9ee7-46c8-9da2-b53e346a89cc tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895" status: 200 len: 1367 microversion: 2.1 time: 0.153789 Jul 12 17:44:53.954113 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 382/777] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:53 2022] GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:53.956343 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-04985953-8620-4d8a-a461-85969fdc48a1 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:53.956841 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-04985953-8620-4d8a-a461-85969fdc48a1 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:53.957575 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-04985953-8620-4d8a-a461-85969fdc48a1 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:53.958019 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-04985953-8620-4d8a-a461-85969fdc48a1 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:54.092559 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-04985953-8620-4d8a-a461-85969fdc48a1 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:54.100083 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-04985953-8620-4d8a-a461-85969fdc48a1 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1522 microversion: 2.1 time: 0.154789 Jul 12 17:44:54.101095 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 396/778] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:53 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:44:54.972367 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b01e6a25-c0c5-490e-ad9d-06534d8161db tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:54.973262 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-b01e6a25-c0c5-490e-ad9d-06534d8161db tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: c0090e22-9f29-42b1-880a-3c7f2ef84895] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:54.981123 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b01e6a25-c0c5-490e-ad9d-06534d8161db tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:54.981566 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b01e6a25-c0c5-490e-ad9d-06534d8161db tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:54.982335 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b01e6a25-c0c5-490e-ad9d-06534d8161db tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:54.982843 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b01e6a25-c0c5-490e-ad9d-06534d8161db tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:55.120158 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ac9fb106-54ce-4bf6-84c1-4b8df7b72af6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:55.121327 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-ac9fb106-54ce-4bf6-84c1-4b8df7b72af6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:55.127150 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-b01e6a25-c0c5-490e-ad9d-06534d8161db tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:55.132708 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:44:55.135242 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ac9fb106-54ce-4bf6-84c1-4b8df7b72af6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:55.135697 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ac9fb106-54ce-4bf6-84c1-4b8df7b72af6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:55.136516 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ac9fb106-54ce-4bf6-84c1-4b8df7b72af6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:55.136982 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ac9fb106-54ce-4bf6-84c1-4b8df7b72af6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:55.137719 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-b01e6a25-c0c5-490e-ad9d-06534d8161db tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895" status: 200 len: 1367 microversion: 2.1 time: 0.170579 Jul 12 17:44:55.148232 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 383/779] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:54 2022] GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:55.345429 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-ac9fb106-54ce-4bf6-84c1-4b8df7b72af6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:55.353579 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-ac9fb106-54ce-4bf6-84c1-4b8df7b72af6 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1522 microversion: 2.1 time: 0.239345 Jul 12 17:44:55.354170 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 397/780] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:55 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:44:56.042113 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-c606ccd3-f84c-4cb8-b195-37192d75cc7f req-3663ed88-a1a4-4185-b9e5-17160c826450 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0090e22-9f29-42b1-880a-3c7f2ef84895", "tag": "578d14a4-10ed-4fd2-88a2-41a179fcacf6"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:44:56.053523 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-c606ccd3-f84c-4cb8-b195-37192d75cc7f req-3663ed88-a1a4-4185-b9e5-17160c826450 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:56.054020 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-c606ccd3-f84c-4cb8-b195-37192d75cc7f req-3663ed88-a1a4-4185-b9e5-17160c826450 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:56.075808 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-c606ccd3-f84c-4cb8-b195-37192d75cc7f req-3663ed88-a1a4-4185-b9e5-17160c826450 service nova] Creating event network-changed:578d14a4-10ed-4fd2-88a2-41a179fcacf6 for instance c0090e22-9f29-42b1-880a-3c7f2ef84895 on hv-cinder-84875 Jul 12 17:44:56.080778 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-c606ccd3-f84c-4cb8-b195-37192d75cc7f req-3663ed88-a1a4-4185-b9e5-17160c826450 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043308 Jul 12 17:44:56.081669 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 384/781] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:44:56.160203 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-232ca58a-53f0-4180-ae04-0d79eaeda58f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:56.160885 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-232ca58a-53f0-4180-ae04-0d79eaeda58f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: c0090e22-9f29-42b1-880a-3c7f2ef84895] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:56.169607 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-232ca58a-53f0-4180-ae04-0d79eaeda58f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:56.170144 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-232ca58a-53f0-4180-ae04-0d79eaeda58f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:56.171273 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-232ca58a-53f0-4180-ae04-0d79eaeda58f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:56.171739 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-232ca58a-53f0-4180-ae04-0d79eaeda58f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:56.242922 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-c147fdb4-31c2-4a2c-a557-a5fa73a50a5a req-7926939f-618f-465d-9191-7c5814aac7f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c50a610-ffbb-40cc-b1d3-b05a598c7e3a", "name": "network-vif-deleted", "tag": "5f828fa0-9a14-4714-96d9-422ef2b20526"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:44:56.253037 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-c147fdb4-31c2-4a2c-a557-a5fa73a50a5a req-7926939f-618f-465d-9191-7c5814aac7f9 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:56.253500 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-c147fdb4-31c2-4a2c-a557-a5fa73a50a5a req-7926939f-618f-465d-9191-7c5814aac7f9 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:56.267153 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-c147fdb4-31c2-4a2c-a557-a5fa73a50a5a req-7926939f-618f-465d-9191-7c5814aac7f9 service nova] Creating event network-vif-deleted:5f828fa0-9a14-4714-96d9-422ef2b20526 for instance 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a on hv-cinder-84875 Jul 12 17:44:56.275093 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-c147fdb4-31c2-4a2c-a557-a5fa73a50a5a req-7926939f-618f-465d-9191-7c5814aac7f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114301 Jul 12 17:44:56.280037 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 385/782] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:44:56.372201 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-1b79c125-0d5d-4937-a3fd-aeb589ecf195 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:56.389901 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-1b79c125-0d5d-4937-a3fd-aeb589ecf195 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:56.389901 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1b79c125-0d5d-4937-a3fd-aeb589ecf195 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:56.389901 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1b79c125-0d5d-4937-a3fd-aeb589ecf195 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:56.389901 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1b79c125-0d5d-4937-a3fd-aeb589ecf195 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:56.390493 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1b79c125-0d5d-4937-a3fd-aeb589ecf195 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:56.425777 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-232ca58a-53f0-4180-ae04-0d79eaeda58f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:56.434653 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-232ca58a-53f0-4180-ae04-0d79eaeda58f tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895" status: 200 len: 1367 microversion: 2.1 time: 0.283662 Jul 12 17:44:56.436160 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 398/783] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:56 2022] GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895 => generated 1367 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:56.456526 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-1b79c125-0d5d-4937-a3fd-aeb589ecf195 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09df98c929416e8ca67b0728349bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c73f9a78743e9b24b2b6ff47d7ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:56.465930 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-1b79c125-0d5d-4937-a3fd-aeb589ecf195 tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 200 len: 1480 microversion: 2.1 time: 0.098370 Jul 12 17:44:56.474845 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 386/784] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:56 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 1480 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:44:57.453118 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-64f3d37f-9298-4271-ac49-2c3b6276a6c4 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:57.453736 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-64f3d37f-9298-4271-ac49-2c3b6276a6c4 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: c0090e22-9f29-42b1-880a-3c7f2ef84895] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:57.460308 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-64f3d37f-9298-4271-ac49-2c3b6276a6c4 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:57.460815 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-64f3d37f-9298-4271-ac49-2c3b6276a6c4 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:57.461579 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-64f3d37f-9298-4271-ac49-2c3b6276a6c4 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:57.462063 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-64f3d37f-9298-4271-ac49-2c3b6276a6c4 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:57.483730 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b9c7e8a9-c197-4174-8f9b-838f86745fcf tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:57.484337 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-b9c7e8a9-c197-4174-8f9b-838f86745fcf tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] [instance: 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:57.493272 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b9c7e8a9-c197-4174-8f9b-838f86745fcf tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:57.493734 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b9c7e8a9-c197-4174-8f9b-838f86745fcf tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:57.494596 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b9c7e8a9-c197-4174-8f9b-838f86745fcf tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:57.495101 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b9c7e8a9-c197-4174-8f9b-838f86745fcf tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:57.514194 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.wsgi [None req-b9c7e8a9-c197-4174-8f9b-838f86745fcf tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] HTTP exception thrown: Instance 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a could not be found. Jul 12 17:44:57.515939 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b9c7e8a9-c197-4174-8f9b-838f86745fcf tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Request method failure captured: Jul 12 17:44:57.515939 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: request: GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a HTTP/1.1 Jul 12 17:44:57.515939 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept: application/json Jul 12 17:44:57.515939 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept-Encoding: identity Jul 12 17:44:57.515939 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Connection: close Jul 12 17:44:57.515939 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Length: 0 Jul 12 17:44:57.515939 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Type: application/json Jul 12 17:44:57.515939 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Host: 10.222.0.16 Jul 12 17:44:57.515939 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Openstack-System-Scope: None Jul 12 17:44:57.515939 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: User-Agent: python-urllib3/1.26.9 Jul 12 17:44:57.515939 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Auth-Token: gAAAAABizbHBn2P0AAPTeyjvRqGGm6Weg8HxPH-97n_6a8wVovT5QO-_rMGfsCxsgiu9EaBIW-KFncOPHrJH7Qnqsze2YkwIJvtmH_T_TgjuioF1uYFHDL21pP5xK7Y-mYfYQH4WSfEr_stqyIxKbKplZI_fQ0LBE7l4xFC8cVH7u9H_iS3Qd18 Jul 12 17:44:57.515939 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Id: None Jul 12 17:44:57.515939 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Name: None Jul 12 17:44:57.515939 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Identity-Status: Confirmed Jul 12 17:44:57.515939 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Is-Admin-Project: True Jul 12 17:44:57.515939 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Id: default Jul 12 17:44:57.515939 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Name: Default Jul 12 17:44:57.515939 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Id: 497c73f9a78743e9b24b2b6ff47d7ede Jul 12 17:44:57.515939 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-151557955 Jul 12 17:44:57.515939 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Role: reader,member Jul 12 17:44:57.515939 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Roles: reader,member Jul 12 17:44:57.517498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/497c73f9a78743e9b24b2b6ff47d7ede"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_497c73f9a78743e9b24b2b6ff47d7ede", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/497c73f9a78743e9b24b2b6ff47d7ede"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/497c73f9a78743e9b24b2b6ff47d7ede"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:44:57.517498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant: tempest-ServerRescueNegativeTestJSON-151557955 Jul 12 17:44:57.517498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Id: 497c73f9a78743e9b24b2b6ff47d7ede Jul 12 17:44:57.517498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-151557955 Jul 12 17:44:57.517498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User: tempest-ServerRescueNegativeTestJSON-151557955-project Jul 12 17:44:57.517498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Id: default Jul 12 17:44:57.517498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Name: Default Jul 12 17:44:57.517498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Id: ce09df98c929416e8ca67b0728349bfb Jul 12 17:44:57.517498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Name: tempest-ServerRescueNegativeTestJSON-151557955-project Jul 12 17:44:57.517498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: method: > Jul 12 17:44:57.517498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: exception: Instance 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a could not be found. Jul 12 17:44:57.517498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: action_args: {'id': '0c50a610-ffbb-40cc-b1d3-b05a598c7e3a'} Jul 12 17:44:57.518846 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:44:57.518846 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:44:57.518846 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:44:57.518846 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:44:57.518846 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:44:57.518846 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:44:57.518846 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:44:57.518846 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:44:57.518846 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:44:57.518846 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:44:57.518846 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a could not be found. Jul 12 17:44:57.518846 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:44:57.518846 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:44:57.518846 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:44:57.518846 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:44:57.518846 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:44:57.518846 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:44:57.518846 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:44:57.518846 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:44:57.518846 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:44:57.520463 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:44:57.520463 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:44:57.520463 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:44:57.520463 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:44:57.520463 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:44:57.520463 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:44:57.520463 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:44:57.520463 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a could not be found. Jul 12 17:44:57.520463 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:44:57.520463 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:44:57.520463 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:44:57.520463 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:44:57.520463 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:44:57.520463 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:44:57.520463 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:44:57.520463 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:44:57.520463 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a could not be found. Jul 12 17:44:57.520463 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:44:57.521869 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b9c7e8a9-c197-4174-8f9b-838f86745fcf tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] Returning 404 to user: Instance 0c50a610-ffbb-40cc-b1d3-b05a598c7e3a could not be found. {{(pid=130058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:44:57.521869 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-b9c7e8a9-c197-4174-8f9b-838f86745fcf tempest-ServerRescueNegativeTestJSON-151557955 tempest-ServerRescueNegativeTestJSON-151557955-project] 10.222.0.16 "GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a" status: 404 len: 111 microversion: 2.1 time: 0.037825 Jul 12 17:44:57.521869 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 387/785] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:57 2022] GET /compute/v2.1/servers/0c50a610-ffbb-40cc-b1d3-b05a598c7e3a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 17:44:57.852276 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-64f3d37f-9298-4271-ac49-2c3b6276a6c4 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:57.859944 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-64f3d37f-9298-4271-ac49-2c3b6276a6c4 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895" status: 200 len: 1367 microversion: 2.1 time: 0.410977 Jul 12 17:44:57.860530 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 399/786] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:57 2022] GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895 => generated 1367 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:58.877039 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-d364a8db-edb5-445a-82d1-9e630188a7a9 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:58.877649 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-d364a8db-edb5-445a-82d1-9e630188a7a9 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: c0090e22-9f29-42b1-880a-3c7f2ef84895] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:58.879691 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell0:SELECT=6 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:44:58.885337 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d364a8db-edb5-445a-82d1-9e630188a7a9 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:58.885830 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d364a8db-edb5-445a-82d1-9e630188a7a9 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:58.886629 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d364a8db-edb5-445a-82d1-9e630188a7a9 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:58.887068 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d364a8db-edb5-445a-82d1-9e630188a7a9 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:59.119772 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-d364a8db-edb5-445a-82d1-9e630188a7a9 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:59.127306 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-d364a8db-edb5-445a-82d1-9e630188a7a9 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895" status: 200 len: 1367 microversion: 2.1 time: 0.254200 Jul 12 17:44:59.127885 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 388/787] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:58 2022] GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:00.149228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-c353544a-e898-4687-ac48-3d70856519a8 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:00.149228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-c353544a-e898-4687-ac48-3d70856519a8 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: c0090e22-9f29-42b1-880a-3c7f2ef84895] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:00.152361 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell0:SELECT=2 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:45:00.153050 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell0:SELECT=6 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:45:00.157279 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c353544a-e898-4687-ac48-3d70856519a8 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:00.157784 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c353544a-e898-4687-ac48-3d70856519a8 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:00.158604 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c353544a-e898-4687-ac48-3d70856519a8 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:00.159050 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c353544a-e898-4687-ac48-3d70856519a8 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:00.314267 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-c353544a-e898-4687-ac48-3d70856519a8 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:00.322613 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-c353544a-e898-4687-ac48-3d70856519a8 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895" status: 200 len: 1367 microversion: 2.1 time: 0.182013 Jul 12 17:45:00.323202 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 400/788] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:00 2022] GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:45:01.340171 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-f25050e5-61e5-4243-ad16-12096a12bf74 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:01.342390 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-f25050e5-61e5-4243-ad16-12096a12bf74 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: c0090e22-9f29-42b1-880a-3c7f2ef84895] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:01.352514 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f25050e5-61e5-4243-ad16-12096a12bf74 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:01.353004 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f25050e5-61e5-4243-ad16-12096a12bf74 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:01.353810 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f25050e5-61e5-4243-ad16-12096a12bf74 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:01.355007 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f25050e5-61e5-4243-ad16-12096a12bf74 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:01.583266 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-f25050e5-61e5-4243-ad16-12096a12bf74 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:01.591737 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-f25050e5-61e5-4243-ad16-12096a12bf74 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895" status: 200 len: 1367 microversion: 2.1 time: 0.255639 Jul 12 17:45:01.592330 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 389/789] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:01 2022] GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895 => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:02.613466 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-1378a3d3-fa82-4419-a5e9-d2499b430f63 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:02.614092 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-1378a3d3-fa82-4419-a5e9-d2499b430f63 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: c0090e22-9f29-42b1-880a-3c7f2ef84895] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:02.621364 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1378a3d3-fa82-4419-a5e9-d2499b430f63 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:02.622210 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1378a3d3-fa82-4419-a5e9-d2499b430f63 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:02.623433 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1378a3d3-fa82-4419-a5e9-d2499b430f63 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:02.624080 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1378a3d3-fa82-4419-a5e9-d2499b430f63 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:02.778651 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-1378a3d3-fa82-4419-a5e9-d2499b430f63 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:02.789596 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-1378a3d3-fa82-4419-a5e9-d2499b430f63 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895" status: 200 len: 1367 microversion: 2.1 time: 0.180198 Jul 12 17:45:02.790191 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 401/790] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:02 2022] GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:03.056347 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-06710590-cf02-43d9-af1f-f2a375da5ab5 req-2cff6f70-5465-4837-be02-67b27126ad2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0090e22-9f29-42b1-880a-3c7f2ef84895", "name": "network-vif-plugged", "status": "completed", "tag": "578d14a4-10ed-4fd2-88a2-41a179fcacf6"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:45:03.064509 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-06710590-cf02-43d9-af1f-f2a375da5ab5 req-2cff6f70-5465-4837-be02-67b27126ad2f service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:03.064948 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-06710590-cf02-43d9-af1f-f2a375da5ab5 req-2cff6f70-5465-4837-be02-67b27126ad2f service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:03.076330 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-06710590-cf02-43d9-af1f-f2a375da5ab5 req-2cff6f70-5465-4837-be02-67b27126ad2f service nova] Creating event network-vif-plugged:578d14a4-10ed-4fd2-88a2-41a179fcacf6 for instance c0090e22-9f29-42b1-880a-3c7f2ef84895 on hv-cinder-84875 Jul 12 17:45:03.081873 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-06710590-cf02-43d9-af1f-f2a375da5ab5 req-2cff6f70-5465-4837-be02-67b27126ad2f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224335 Jul 12 17:45:03.082342 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 390/791] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:45:03.806897 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a057532f-57f3-4d85-b9da-8454d1188a96 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:03.807714 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-a057532f-57f3-4d85-b9da-8454d1188a96 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: c0090e22-9f29-42b1-880a-3c7f2ef84895] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:03.814243 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a057532f-57f3-4d85-b9da-8454d1188a96 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:03.814835 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a057532f-57f3-4d85-b9da-8454d1188a96 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:03.815587 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a057532f-57f3-4d85-b9da-8454d1188a96 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:03.816032 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a057532f-57f3-4d85-b9da-8454d1188a96 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:03.953845 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a057532f-57f3-4d85-b9da-8454d1188a96 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:03.961936 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-a057532f-57f3-4d85-b9da-8454d1188a96 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895" status: 200 len: 1367 microversion: 2.1 time: 0.159667 Jul 12 17:45:03.962826 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 402/792] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:03 2022] GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:04.980944 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-d881d7b6-1b6e-4601-b598-83160e3b99aa tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:04.981527 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-d881d7b6-1b6e-4601-b598-83160e3b99aa tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: c0090e22-9f29-42b1-880a-3c7f2ef84895] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:04.983398 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:45:04.988536 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d881d7b6-1b6e-4601-b598-83160e3b99aa tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:04.988972 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d881d7b6-1b6e-4601-b598-83160e3b99aa tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:04.989749 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d881d7b6-1b6e-4601-b598-83160e3b99aa tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:04.990184 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d881d7b6-1b6e-4601-b598-83160e3b99aa tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:05.136224 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-d881d7b6-1b6e-4601-b598-83160e3b99aa tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:05.144244 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-d881d7b6-1b6e-4601-b598-83160e3b99aa tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895" status: 200 len: 1556 microversion: 2.1 time: 0.168449 Jul 12 17:45:05.144823 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 391/793] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:04 2022] GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895 => generated 1556 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:05.162104 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-bda3c1e9-aefe-47c2-bcf6-2e85cac7d508 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:05.162694 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-bda3c1e9-aefe-47c2-bcf6-2e85cac7d508 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: c0090e22-9f29-42b1-880a-3c7f2ef84895] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:05.164974 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:45:05.169804 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bda3c1e9-aefe-47c2-bcf6-2e85cac7d508 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:05.170379 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bda3c1e9-aefe-47c2-bcf6-2e85cac7d508 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:05.171188 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bda3c1e9-aefe-47c2-bcf6-2e85cac7d508 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:05.171660 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bda3c1e9-aefe-47c2-bcf6-2e85cac7d508 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:05.260532 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-bda3c1e9-aefe-47c2-bcf6-2e85cac7d508 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102384 Jul 12 17:45:05.261169 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 403/794] 10.222.0.16 () {58 vars in 1274 bytes} [Tue Jul 12 17:45:05 2022] GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:45:06.447591 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-20dd34e0-00c2-4402-bed0-5467b8e036e8 req-b6152ed8-d54d-4063-9d4b-a2fb3700e928 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0090e22-9f29-42b1-880a-3c7f2ef84895", "tag": "578d14a4-10ed-4fd2-88a2-41a179fcacf6"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:45:06.459363 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-20dd34e0-00c2-4402-bed0-5467b8e036e8 req-b6152ed8-d54d-4063-9d4b-a2fb3700e928 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:06.460564 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-20dd34e0-00c2-4402-bed0-5467b8e036e8 req-b6152ed8-d54d-4063-9d4b-a2fb3700e928 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:06.482623 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-20dd34e0-00c2-4402-bed0-5467b8e036e8 req-b6152ed8-d54d-4063-9d4b-a2fb3700e928 service nova] Creating event network-changed:578d14a4-10ed-4fd2-88a2-41a179fcacf6 for instance c0090e22-9f29-42b1-880a-3c7f2ef84895 on hv-cinder-84875 Jul 12 17:45:06.488985 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-20dd34e0-00c2-4402-bed0-5467b8e036e8 req-b6152ed8-d54d-4063-9d4b-a2fb3700e928 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045596 Jul 12 17:45:06.490110 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 392/795] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:45:08.535008 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-c8e887fe-dc0e-43c0-8949-80fc62665499 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:08.535622 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-c8e887fe-dc0e-43c0-8949-80fc62665499 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:08.542901 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c8e887fe-dc0e-43c0-8949-80fc62665499 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:08.543424 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c8e887fe-dc0e-43c0-8949-80fc62665499 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:08.544342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c8e887fe-dc0e-43c0-8949-80fc62665499 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:08.544835 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c8e887fe-dc0e-43c0-8949-80fc62665499 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:08.573423 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-c8e887fe-dc0e-43c0-8949-80fc62665499 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Going to try to terminate instance {{(pid=130059) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:45:09.021078 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-c8e887fe-dc0e-43c0-8949-80fc62665499 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "DELETE /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 204 len: 0 microversion: 2.1 time: 0.490435 Jul 12 17:45:09.021711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 404/796] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 12 17:45:08 2022] DELETE /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:45:09.030905 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-5a1e917c-699f-4fbd-82e7-5f5fead0bf6f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:09.032312 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-5a1e917c-699f-4fbd-82e7-5f5fead0bf6f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:09.041368 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5a1e917c-699f-4fbd-82e7-5f5fead0bf6f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:09.042425 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5a1e917c-699f-4fbd-82e7-5f5fead0bf6f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:09.042866 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5a1e917c-699f-4fbd-82e7-5f5fead0bf6f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:09.043406 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5a1e917c-699f-4fbd-82e7-5f5fead0bf6f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:09.199082 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-5a1e917c-699f-4fbd-82e7-5f5fead0bf6f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:09.207041 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-5a1e917c-699f-4fbd-82e7-5f5fead0bf6f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1579 microversion: 2.1 time: 0.180294 Jul 12 17:45:09.207854 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 393/797] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:09 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1579 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:45:09.680692 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-212a7e23-bb45-4837-8291-009dc9eccaae tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-602816"}} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:45:09.681302 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-212a7e23-bb45-4837-8291-009dc9eccaae tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:09.688879 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-212a7e23-bb45-4837-8291-009dc9eccaae tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:09.690272 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-212a7e23-bb45-4837-8291-009dc9eccaae tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:09.690272 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-212a7e23-bb45-4837-8291-009dc9eccaae tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:09.690691 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-212a7e23-bb45-4837-8291-009dc9eccaae tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:09.923217 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.network.security_group_api [None req-212a7e23-bb45-4837-8291-009dc9eccaae tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Removing security group be217aa0-f3cc-4920-b202-4b15237a815b from port c4901ed1-f277-462c-b8b5-c19838c33e73 Jul 12 17:45:10.294263 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-9c4fdedb-493d-4c82-9e04-f029c6c6092d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Action: 'create', calling method: .version_select at 0x7f479fb0bb80>, body: {"keypair": {"name": "tempest-keypair-2084892738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDnJZmxDGKm4/F5aZsRFsRD6UrWxKWzZhmR64wZIiqAIHAtf9BuuIk/CQ/xU0fi/BYu/UDHokH7L/vFC1wBPJoFlXRc/dPm8gzePavqONxyWr/Xl4xQtDRoOjsSTYRJ2g=="}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:45:10.308988 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-9c4fdedb-493d-4c82-9e04-f029c6c6092d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Getting quotas for project 041c2c26c82a44d98d2229969c1f3618. Resources: {'key_pairs'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:45:10.313116 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-9c4fdedb-493d-4c82-9e04-f029c6c6092d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Getting quotas for user e3d86a1cde9f407cae8ac050fe000d47 and project 041c2c26c82a44d98d2229969c1f3618. Resources: {'key_pairs'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:45:10.393818 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-9c4fdedb-493d-4c82-9e04-f029c6c6092d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.225803 Jul 12 17:45:10.399073 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 394/798] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Jul 12 17:45:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:45:10.406252 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-e095923e-75df-4f6a-a57c-d975b98e4191 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:10.406252 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-e095923e-75df-4f6a-a57c-d975b98e4191 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:10.416629 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e095923e-75df-4f6a-a57c-d975b98e4191 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:10.416858 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e095923e-75df-4f6a-a57c-d975b98e4191 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:10.417666 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e095923e-75df-4f6a-a57c-d975b98e4191 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:10.418113 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e095923e-75df-4f6a-a57c-d975b98e4191 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:10.419977 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-212a7e23-bb45-4837-8291-009dc9eccaae tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "POST /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72/action" status: 202 len: 0 microversion: 2.1 time: 0.744865 Jul 12 17:45:10.420792 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 405/799] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jul 12 17:45:09 2022] POST /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72/action => generated 0 bytes in 747 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:45:10.431825 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-75a8e659-dc51-4904-ade3-faf4a268f093 req-7c6079cb-9a7e-4acd-b709-9d5a5c1d3053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d57de92-32ca-4ff9-a5ea-00d7e83bbf72", "tag": "c4901ed1-f277-462c-b8b5-c19838c33e73"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:45:10.440818 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-75a8e659-dc51-4904-ade3-faf4a268f093 req-7c6079cb-9a7e-4acd-b709-9d5a5c1d3053 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:10.441529 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-75a8e659-dc51-4904-ade3-faf4a268f093 req-7c6079cb-9a7e-4acd-b709-9d5a5c1d3053 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:10.458924 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-75a8e659-dc51-4904-ade3-faf4a268f093 req-7c6079cb-9a7e-4acd-b709-9d5a5c1d3053 service nova] Creating event network-changed:c4901ed1-f277-462c-b8b5-c19838c33e73 for instance 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 on hv-cinder-84875 Jul 12 17:45:10.472268 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-75a8e659-dc51-4904-ade3-faf4a268f093 req-7c6079cb-9a7e-4acd-b709-9d5a5c1d3053 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041125 Jul 12 17:45:10.473789 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 406/800] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:45:10.909358 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-e095923e-75df-4f6a-a57c-d975b98e4191 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:10.917383 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-e095923e-75df-4f6a-a57c-d975b98e4191 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1579 microversion: 2.1 time: 0.517044 Jul 12 17:45:10.921102 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 395/801] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:10 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1579 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:11.939415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-df728ab2-6d14-4ddc-80ac-52d832be75ab tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:11.940125 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-df728ab2-6d14-4ddc-80ac-52d832be75ab tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:11.947926 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-df728ab2-6d14-4ddc-80ac-52d832be75ab tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:11.948297 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-df728ab2-6d14-4ddc-80ac-52d832be75ab tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:11.954957 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-df728ab2-6d14-4ddc-80ac-52d832be75ab tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:11.955426 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-df728ab2-6d14-4ddc-80ac-52d832be75ab tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:12.196697 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-df728ab2-6d14-4ddc-80ac-52d832be75ab tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:12.206625 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-df728ab2-6d14-4ddc-80ac-52d832be75ab tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1579 microversion: 2.1 time: 0.272683 Jul 12 17:45:12.207232 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 407/802] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:11 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1579 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:12.265524 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-81026069-d26f-4620-8da0-551fc8c10d0d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:12.266304 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-81026069-d26f-4620-8da0-551fc8c10d0d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:12.289702 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-81026069-d26f-4620-8da0-551fc8c10d0d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:12.291387 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-81026069-d26f-4620-8da0-551fc8c10d0d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:12.291387 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-81026069-d26f-4620-8da0-551fc8c10d0d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:12.292183 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-81026069-d26f-4620-8da0-551fc8c10d0d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:12.432981 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.objects.instance [None req-81026069-d26f-4620-8da0-551fc8c10d0d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lazy-loading 'services' on Instance uuid 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 {{(pid=130058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:45:12.505604 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-7e760821-0625-4f1d-9869-eaedb774d763 req-72a2de8c-d7b8-4068-834c-e0eec2e72980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73d03675-d5c4-4778-a9c2-320d010588b7", "name": "network-vif-deleted", "tag": "9dd6e257-1f75-4cdb-b508-53b460481a96"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:45:12.544500 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-7e760821-0625-4f1d-9869-eaedb774d763 req-72a2de8c-d7b8-4068-834c-e0eec2e72980 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:12.547705 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-7e760821-0625-4f1d-9869-eaedb774d763 req-72a2de8c-d7b8-4068-834c-e0eec2e72980 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:12.575424 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-7e760821-0625-4f1d-9869-eaedb774d763 req-72a2de8c-d7b8-4068-834c-e0eec2e72980 service nova] Creating event network-vif-deleted:9dd6e257-1f75-4cdb-b508-53b460481a96 for instance 73d03675-d5c4-4778-a9c2-320d010588b7 on hv-cinder-84875 Jul 12 17:45:12.580741 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-7e760821-0625-4f1d-9869-eaedb774d763 req-72a2de8c-d7b8-4068-834c-e0eec2e72980 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080911 Jul 12 17:45:12.585830 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 408/803] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:45:12.594263 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-820a8395-5d72-4e7b-ad83-41a4829e94e5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:12.594932 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-820a8395-5d72-4e7b-ad83-41a4829e94e5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:12.604415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-820a8395-5d72-4e7b-ad83-41a4829e94e5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:12.605233 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-820a8395-5d72-4e7b-ad83-41a4829e94e5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:12.619985 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-820a8395-5d72-4e7b-ad83-41a4829e94e5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:12.620724 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-820a8395-5d72-4e7b-ad83-41a4829e94e5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:12.627411 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:45:12.657084 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-820a8395-5d72-4e7b-ad83-41a4829e94e5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe/ips" status: 200 len: 151 microversion: 2.20 time: 0.069574 Jul 12 17:45:12.663312 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 409/804] 10.222.0.16 () {60 vars in 1288 bytes} [Tue Jul 12 17:45:12 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe/ips => generated 151 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:45:12.673429 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-117ce333-4c93-4581-a0a0-ffc8d46b7225 req-f52ae4c9-c37e-49a4-888f-3d7f32ae15c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d57de92-32ca-4ff9-a5ea-00d7e83bbf72", "tag": "c4901ed1-f277-462c-b8b5-c19838c33e73"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:45:12.687731 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-117ce333-4c93-4581-a0a0-ffc8d46b7225 req-f52ae4c9-c37e-49a4-888f-3d7f32ae15c6 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:12.688913 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-117ce333-4c93-4581-a0a0-ffc8d46b7225 req-f52ae4c9-c37e-49a4-888f-3d7f32ae15c6 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:12.702210 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-117ce333-4c93-4581-a0a0-ffc8d46b7225 req-f52ae4c9-c37e-49a4-888f-3d7f32ae15c6 service nova] Creating event network-changed:c4901ed1-f277-462c-b8b5-c19838c33e73 for instance 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 on hv-cinder-84875 Jul 12 17:45:12.709257 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-117ce333-4c93-4581-a0a0-ffc8d46b7225 req-f52ae4c9-c37e-49a4-888f-3d7f32ae15c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049807 Jul 12 17:45:12.710752 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 410/805] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:45:12.718030 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-81026069-d26f-4620-8da0-551fc8c10d0d tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72/os-volume_attachments/486111e8-7884-4bda-b39f-dbf471baa84a" status: 202 len: 0 microversion: 2.1 time: 0.457123 Jul 12 17:45:12.721926 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 396/806] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jul 12 17:45:12 2022] DELETE /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72/os-volume_attachments/486111e8-7884-4bda-b39f-dbf471baa84a => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:45:12.728682 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-1b9d1547-62e9-4213-bb05-478ba0befc47 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:12.729860 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-1b9d1547-62e9-4213-bb05-478ba0befc47 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:12.755084 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1b9d1547-62e9-4213-bb05-478ba0befc47 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:12.755552 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1b9d1547-62e9-4213-bb05-478ba0befc47 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:12.756412 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1b9d1547-62e9-4213-bb05-478ba0befc47 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:12.756943 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1b9d1547-62e9-4213-bb05-478ba0befc47 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:12.847774 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-1b9d1547-62e9-4213-bb05-478ba0befc47 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124193 Jul 12 17:45:12.850640 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 411/807] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:45:12 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:45:13.225993 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-c83d9aa1-b971-455e-838d-3cb05a88758e tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:13.227743 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-c83d9aa1-b971-455e-838d-3cb05a88758e tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:13.237296 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c83d9aa1-b971-455e-838d-3cb05a88758e tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:13.238348 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c83d9aa1-b971-455e-838d-3cb05a88758e tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:13.239954 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c83d9aa1-b971-455e-838d-3cb05a88758e tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:13.243259 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c83d9aa1-b971-455e-838d-3cb05a88758e tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:13.437233 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-c83d9aa1-b971-455e-838d-3cb05a88758e tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:13.451508 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-c83d9aa1-b971-455e-838d-3cb05a88758e tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1226 microversion: 2.1 time: 0.226171 Jul 12 17:45:13.454592 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 397/808] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:13 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1226 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:13.863998 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-947ec095-a9cd-44b8-87cc-3a21a65ba317 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:13.863998 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-947ec095-a9cd-44b8-87cc-3a21a65ba317 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:13.882547 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-947ec095-a9cd-44b8-87cc-3a21a65ba317 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:13.884541 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-947ec095-a9cd-44b8-87cc-3a21a65ba317 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:13.885574 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-947ec095-a9cd-44b8-87cc-3a21a65ba317 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:13.886177 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-947ec095-a9cd-44b8-87cc-3a21a65ba317 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:13.942489 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-947ec095-a9cd-44b8-87cc-3a21a65ba317 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084738 Jul 12 17:45:13.948178 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 412/809] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:45:13 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:45:14.476793 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-c15fa27a-b5cb-4903-89ff-52d5d42f036f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:14.477422 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-c15fa27a-b5cb-4903-89ff-52d5d42f036f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:14.485194 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c15fa27a-b5cb-4903-89ff-52d5d42f036f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:14.492661 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c15fa27a-b5cb-4903-89ff-52d5d42f036f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:14.492661 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c15fa27a-b5cb-4903-89ff-52d5d42f036f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:14.492661 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c15fa27a-b5cb-4903-89ff-52d5d42f036f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:14.544536 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c15fa27a-b5cb-4903-89ff-52d5d42f036f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:14.545331 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c15fa27a-b5cb-4903-89ff-52d5d42f036f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:14.548277 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.objects.instance [None req-c15fa27a-b5cb-4903-89ff-52d5d42f036f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lazy-loading 'fault' on Instance uuid 73d03675-d5c4-4778-a9c2-320d010588b7 {{(pid=130058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:45:14.599014 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-5c808edc-a4b3-4dba-9e58-930d9d8de113 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-353945405", "imageRef": "cb077f42-97cd-41cf-8758-764c562534f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "54486e6f-4939-452b-9a54-f7e95a6dd84a"}], "security_groups": [{"name": "tempest-securitygroup--219578668"}], "key_name": "tempest-keypair-2084892738", "user_data": "}} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:45:14.635003 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-c15fa27a-b5cb-4903-89ff-52d5d42f036f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:14.658095 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-c15fa27a-b5cb-4903-89ff-52d5d42f036f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 200 len: 1231 microversion: 2.1 time: 0.188502 Jul 12 17:45:14.666172 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 398/810] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:14 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 1231 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:14.794085 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.network.neutron [None req-5c808edc-a4b3-4dba-9e58-930d9d8de113 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] validate_networks() for [('54486e6f-4939-452b-9a54-f7e95a6dd84a', None, None, None, None, None)] {{(pid=130059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:45:14.957478 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-aab47ff8-512b-4d71-87d3-21a154de9ab8 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:14.958629 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-aab47ff8-512b-4d71-87d3-21a154de9ab8 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:14.966527 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-aab47ff8-512b-4d71-87d3-21a154de9ab8 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:14.972096 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-aab47ff8-512b-4d71-87d3-21a154de9ab8 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:14.972096 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-aab47ff8-512b-4d71-87d3-21a154de9ab8 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:14.972801 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-aab47ff8-512b-4d71-87d3-21a154de9ab8 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:15.029960 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-aab47ff8-512b-4d71-87d3-21a154de9ab8 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076546 Jul 12 17:45:15.031041 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 399/811] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:45:14 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 17:45:15.041510 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-7209e172-bbfe-44d0-89bc-af9465baa56f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:15.052518 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-7209e172-bbfe-44d0-89bc-af9465baa56f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:15.054089 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7209e172-bbfe-44d0-89bc-af9465baa56f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:15.054089 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7209e172-bbfe-44d0-89bc-af9465baa56f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:15.056486 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7209e172-bbfe-44d0-89bc-af9465baa56f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:15.056486 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7209e172-bbfe-44d0-89bc-af9465baa56f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:15.150787 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.wsgi [None req-7209e172-bbfe-44d0-89bc-af9465baa56f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] HTTP exception thrown: Instance 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 is not attached to volume 486111e8-7884-4bda-b39f-dbf471baa84a Jul 12 17:45:15.157313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-7209e172-bbfe-44d0-89bc-af9465baa56f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Request method failure captured: Jul 12 17:45:15.157313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: request: DELETE /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72/os-volume_attachments/486111e8-7884-4bda-b39f-dbf471baa84a HTTP/1.1 Jul 12 17:45:15.157313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept: application/json Jul 12 17:45:15.157313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept-Encoding: identity Jul 12 17:45:15.157313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Connection: close Jul 12 17:45:15.157313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Length: 0 Jul 12 17:45:15.157313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Type: application/json Jul 12 17:45:15.157313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Host: 10.222.0.16 Jul 12 17:45:15.157313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Openstack-System-Scope: None Jul 12 17:45:15.157313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: User-Agent: python-urllib3/1.26.9 Jul 12 17:45:15.157313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Auth-Token: gAAAAABizbJt-2o7qoeS3bSHwuy0n3ICAf6xXbVwFC0svMc_dx0mm4y9DNhFJiHsWmdoWjBhhsI3cWjgHd9uSQi7x9cdSYzHKUTjC-wL-awmqTdm9LufDgbkdZ_fC2S4xssOfHTiQUQMF1w0krAqAxUu8S8zDS2MxtMRrzPiLgaL3ApJ7cl_weo Jul 12 17:45:15.157313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Id: None Jul 12 17:45:15.157313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Name: None Jul 12 17:45:15.157313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Identity-Status: Confirmed Jul 12 17:45:15.157313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Is-Admin-Project: True Jul 12 17:45:15.157313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Id: default Jul 12 17:45:15.157313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Name: Default Jul 12 17:45:15.157313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Id: 80285308991b47308701fd3363bec122 Jul 12 17:45:15.157313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Name: tempest-TestMinimumBasicScenario-1474592602 Jul 12 17:45:15.157313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Role: reader,member Jul 12 17:45:15.157313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Roles: reader,member Jul 12 17:45:15.158829 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80285308991b47308701fd3363bec122"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_80285308991b47308701fd3363bec122", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80285308991b47308701fd3363bec122"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/80285308991b47308701fd3363bec122"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:45:15.158829 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant: tempest-TestMinimumBasicScenario-1474592602 Jul 12 17:45:15.158829 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Id: 80285308991b47308701fd3363bec122 Jul 12 17:45:15.158829 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1474592602 Jul 12 17:45:15.158829 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User: tempest-TestMinimumBasicScenario-1474592602-project Jul 12 17:45:15.158829 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Id: default Jul 12 17:45:15.158829 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Name: Default Jul 12 17:45:15.158829 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Id: ed4726967dd844b692fa7badd510267a Jul 12 17:45:15.158829 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Name: tempest-TestMinimumBasicScenario-1474592602-project Jul 12 17:45:15.158829 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: method: > Jul 12 17:45:15.158829 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: exception: Instance 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 is not attached to volume 486111e8-7884-4bda-b39f-dbf471baa84a Jul 12 17:45:15.160006 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: action_args: {'server_id': '4d57de92-32ca-4ff9-a5ea-00d7e83bbf72', 'id': '486111e8-7884-4bda-b39f-dbf471baa84a'} Jul 12 17:45:15.160006 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:45:15.160006 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:45:15.160006 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 12 17:45:15.160006 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 12 17:45:15.160006 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 17:45:15.160006 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 17:45:15.160006 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 12 17:45:15.160006 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 12 17:45:15.160006 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 486111e8-7884-4bda-b39f-dbf471baa84a. Jul 12 17:45:15.160006 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:45:15.160006 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:45:15.160006 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:45:15.160006 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:45:15.160006 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:45:15.160006 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:45:15.160006 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:45:15.160006 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:45:15.160006 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:45:15.161589 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:45:15.161589 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 12 17:45:15.161589 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 12 17:45:15.161589 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 is not attached to volume 486111e8-7884-4bda-b39f-dbf471baa84a Jul 12 17:45:15.161589 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:45:15.161589 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:45:15.161589 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:45:15.161589 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:45:15.161589 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:45:15.161589 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:45:15.161589 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:45:15.161589 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:45:15.161589 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 is not attached to volume 486111e8-7884-4bda-b39f-dbf471baa84a Jul 12 17:45:15.161589 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:45:15.161589 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-7209e172-bbfe-44d0-89bc-af9465baa56f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Returning 404 to user: Instance 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 is not attached to volume 486111e8-7884-4bda-b39f-dbf471baa84a {{(pid=130058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:45:15.163726 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-7209e172-bbfe-44d0-89bc-af9465baa56f tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72/os-volume_attachments/486111e8-7884-4bda-b39f-dbf471baa84a" status: 404 len: 154 microversion: 2.1 time: 0.126054 Jul 12 17:45:15.169654 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 400/812] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jul 12 17:45:15 2022] DELETE /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72/os-volume_attachments/486111e8-7884-4bda-b39f-dbf471baa84a => generated 154 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:45:15.176991 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-dc967054-bd67-44cc-b853-772c818c6130 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:45:15.177602 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-dc967054-bd67-44cc-b853-772c818c6130 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:15.185606 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-dc967054-bd67-44cc-b853-772c818c6130 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:15.186301 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-dc967054-bd67-44cc-b853-772c818c6130 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:15.187554 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-dc967054-bd67-44cc-b853-772c818c6130 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:15.188173 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-dc967054-bd67-44cc-b853-772c818c6130 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:15.228342 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.objects.instance [None req-dc967054-bd67-44cc-b853-772c818c6130 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lazy-loading 'flavor' on Instance uuid 07ad3f97-288d-4704-ad33-35bc58e94dfe {{(pid=130058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:45:15.309236 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-5c808edc-a4b3-4dba-9e58-930d9d8de113 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Flavor limits 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:45:15.309732 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-5c808edc-a4b3-4dba-9e58-930d9d8de113 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Image limits 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:45:15.310146 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-5c808edc-a4b3-4dba-9e58-930d9d8de113 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Flavor pref 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:45:15.310592 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-5c808edc-a4b3-4dba-9e58-930d9d8de113 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Image pref 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:45:15.311006 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-5c808edc-a4b3-4dba-9e58-930d9d8de113 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:45:15.321048 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5c808edc-a4b3-4dba-9e58-930d9d8de113 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:15.321406 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5c808edc-a4b3-4dba-9e58-930d9d8de113 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:15.322201 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5c808edc-a4b3-4dba-9e58-930d9d8de113 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:15.322680 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5c808edc-a4b3-4dba-9e58-930d9d8de113 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:15.349073 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.quota [None req-5c808edc-a4b3-4dba-9e58-930d9d8de113 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Getting quotas for project 041c2c26c82a44d98d2229969c1f3618. Resources: {'cores', 'instances', 'ram'} {{(pid=130059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:45:15.354673 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.quota [None req-5c808edc-a4b3-4dba-9e58-930d9d8de113 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Getting quotas for user e3d86a1cde9f407cae8ac050fe000d47 and project 041c2c26c82a44d98d2229969c1f3618. Resources: {'cores', 'instances', 'ram'} {{(pid=130059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:45:15.366998 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-5c808edc-a4b3-4dba-9e58-930d9d8de113 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Going to run 1 instances... {{(pid=130059) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:45:15.371503 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-5c808edc-a4b3-4dba-9e58-930d9d8de113 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb077f42-97cd-41cf-8758-764c562534f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:45:15.499199 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-5c808edc-a4b3-4dba-9e58-930d9d8de113 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.905272 Jul 12 17:45:15.499853 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 413/813] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 12 17:45:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 17:45:15.511214 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-b27e9269-4e3a-4040-a3d3-260e35b284e0 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:15.515142 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-b27e9269-4e3a-4040-a3d3-260e35b284e0 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:15.534943 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:45:15.599044 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-b27e9269-4e3a-4040-a3d3-260e35b284e0 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:15.607364 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-b27e9269-4e3a-4040-a3d3-260e35b284e0 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1237 microversion: 2.1 time: 0.101183 Jul 12 17:45:15.610946 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 414/814] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:15 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1237 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:15.684891 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-c5bec2d2-de22-4ce3-8ede-c52949620304 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:15.685909 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-c5bec2d2-de22-4ce3-8ede-c52949620304 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:15.702981 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c5bec2d2-de22-4ce3-8ede-c52949620304 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:15.703680 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c5bec2d2-de22-4ce3-8ede-c52949620304 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:15.704594 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c5bec2d2-de22-4ce3-8ede-c52949620304 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:15.705344 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c5bec2d2-de22-4ce3-8ede-c52949620304 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:15.725617 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-c5bec2d2-de22-4ce3-8ede-c52949620304 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] HTTP exception thrown: Instance 73d03675-d5c4-4778-a9c2-320d010588b7 could not be found. Jul 12 17:45:15.728414 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-c5bec2d2-de22-4ce3-8ede-c52949620304 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Request method failure captured: Jul 12 17:45:15.728414 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 HTTP/1.1 Jul 12 17:45:15.728414 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:45:15.728414 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:45:15.728414 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:45:15.728414 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 0 Jul 12 17:45:15.728414 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:45:15.728414 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:45:15.728414 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:45:15.728414 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:45:15.728414 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbI4GDLQtc2CxRqirHf0hryzzYqOjcXKT3uKi1BpUomxDXmpafZsj5L8QtMP8_U7R6LmXRVNwS9H_UotzsQ5ktQB0wL3vBc3dCLJ_BQik441Op6NQWj8TNT5rP2bZfLom9YVnx-jGBr2zGSzoLc53wjbLJObazT2tXG1TlhTYmdCREI Jul 12 17:45:15.728414 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:45:15.728414 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:45:15.728414 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:45:15.728414 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:45:15.728414 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:45:15.728414 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:45:15.728414 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: e4b2b488b746454b9f93d67fa3c97809 Jul 12 17:45:15.728414 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-TestVolumeBootPattern-1452615606 Jul 12 17:45:15.728414 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:45:15.728414 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:45:15.730110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4b2b488b746454b9f93d67fa3c97809"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e4b2b488b746454b9f93d67fa3c97809", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4b2b488b746454b9f93d67fa3c97809"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e4b2b488b746454b9f93d67fa3c97809"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:45:15.730110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-TestVolumeBootPattern-1452615606 Jul 12 17:45:15.730110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: e4b2b488b746454b9f93d67fa3c97809 Jul 12 17:45:15.730110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-TestVolumeBootPattern-1452615606 Jul 12 17:45:15.730110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-TestVolumeBootPattern-1452615606-project Jul 12 17:45:15.730110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:45:15.730110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:45:15.730110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: bde6ee9df10146d98991b0d4bb37fc48 Jul 12 17:45:15.730110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-TestVolumeBootPattern-1452615606-project Jul 12 17:45:15.730110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: > Jul 12 17:45:15.730110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Instance 73d03675-d5c4-4778-a9c2-320d010588b7 could not be found. Jul 12 17:45:15.730110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'id': '73d03675-d5c4-4778-a9c2-320d010588b7'} Jul 12 17:45:15.731371 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:45:15.731371 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:45:15.731371 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:45:15.731371 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:45:15.731371 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:45:15.731371 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:45:15.731371 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:45:15.731371 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:45:15.731371 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:45:15.731371 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:45:15.731371 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73d03675-d5c4-4778-a9c2-320d010588b7 could not be found. Jul 12 17:45:15.731371 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:45:15.731371 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:45:15.731371 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:45:15.731371 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:45:15.731371 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:45:15.731371 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:45:15.731371 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:45:15.731371 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:45:15.731371 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:45:15.732954 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:45:15.732954 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:45:15.732954 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:45:15.732954 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:45:15.732954 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:45:15.732954 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:45:15.732954 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:45:15.732954 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73d03675-d5c4-4778-a9c2-320d010588b7 could not be found. Jul 12 17:45:15.732954 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:45:15.732954 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:45:15.732954 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:45:15.732954 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:45:15.732954 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:45:15.732954 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:45:15.732954 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:45:15.732954 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:45:15.732954 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73d03675-d5c4-4778-a9c2-320d010588b7 could not be found. Jul 12 17:45:15.732954 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:45:15.734396 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-c5bec2d2-de22-4ce3-8ede-c52949620304 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Returning 404 to user: Instance 73d03675-d5c4-4778-a9c2-320d010588b7 could not be found. {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:45:15.734396 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-c5bec2d2-de22-4ce3-8ede-c52949620304 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 404 len: 111 microversion: 2.1 time: 0.056520 Jul 12 17:45:15.734956 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 415/815] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:15 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 17:45:15.845685 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-72049b8f-93f4-402c-bc08-1a31909d31e4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-596377728", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1463826168", "security_groups": [{"name": "tempest-secgroup-smoke-2128293980"}], "block_device_mapping_v2": [{"uuid": "866e9c31-fc60-4e0a-99e9-1e1d3f19be6f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2d0ff45d-e690-48e9-9ea7-09279c5e4d10"}]}} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:45:15.846839 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-dc967054-bd67-44cc-b853-772c818c6130 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "POST /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe/action" status: 202 len: 0 microversion: 2.20 time: 0.675605 Jul 12 17:45:15.851342 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 401/816] 10.222.0.16 () {62 vars in 1318 bytes} [Tue Jul 12 17:45:15 2022] POST /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe/action => generated 0 bytes in 677 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:45:15.857514 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-ca772845-f157-4b8f-8d23-8c555b3ea810 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:15.858224 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-ca772845-f157-4b8f-8d23-8c555b3ea810 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:15.864734 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ca772845-f157-4b8f-8d23-8c555b3ea810 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:15.865196 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ca772845-f157-4b8f-8d23-8c555b3ea810 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:15.866009 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ca772845-f157-4b8f-8d23-8c555b3ea810 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:15.866782 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ca772845-f157-4b8f-8d23-8c555b3ea810 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:15.986314 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.network.neutron [None req-72049b8f-93f4-402c-bc08-1a31909d31e4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] validate_networks() for [('2d0ff45d-e690-48e9-9ea7-09279c5e4d10', None, None, None, None, None)] {{(pid=130059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:45:16.017635 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ca772845-f157-4b8f-8d23-8c555b3ea810 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:16.026771 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ca772845-f157-4b8f-8d23-8c555b3ea810 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:16.028327 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ca772845-f157-4b8f-8d23-8c555b3ea810 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:16.029664 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-ca772845-f157-4b8f-8d23-8c555b3ea810 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1722 microversion: 2.20 time: 0.176965 Jul 12 17:45:16.030229 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 402/817] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:15 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:45:16.389560 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-72049b8f-93f4-402c-bc08-1a31909d31e4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Flavor limits 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:45:16.390097 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-72049b8f-93f4-402c-bc08-1a31909d31e4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Image limits 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:45:16.390544 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-72049b8f-93f4-402c-bc08-1a31909d31e4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Flavor pref 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:45:16.390986 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-72049b8f-93f4-402c-bc08-1a31909d31e4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Image pref 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:45:16.391403 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-72049b8f-93f4-402c-bc08-1a31909d31e4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:45:16.402168 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-72049b8f-93f4-402c-bc08-1a31909d31e4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:16.405969 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-72049b8f-93f4-402c-bc08-1a31909d31e4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:16.405969 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-72049b8f-93f4-402c-bc08-1a31909d31e4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:16.405969 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-72049b8f-93f4-402c-bc08-1a31909d31e4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:16.422117 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.quota [None req-72049b8f-93f4-402c-bc08-1a31909d31e4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Getting quotas for project e4b2b488b746454b9f93d67fa3c97809. Resources: {'cores', 'instances', 'ram'} {{(pid=130059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:45:16.427064 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.quota [None req-72049b8f-93f4-402c-bc08-1a31909d31e4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Getting quotas for user bde6ee9df10146d98991b0d4bb37fc48 and project e4b2b488b746454b9f93d67fa3c97809. Resources: {'cores', 'instances', 'ram'} {{(pid=130059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:45:16.494239 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-72049b8f-93f4-402c-bc08-1a31909d31e4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Going to run 1 instances... {{(pid=130059) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:45:16.496332 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-72049b8f-93f4-402c-bc08-1a31909d31e4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: ca00771c-f3e8-47de-aafc-9eb8a1a785b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='866e9c31-fc60-4e0a-99e9-1e1d3f19be6f',volume_size=None,volume_type=None)] {{(pid=130059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:45:16.514888 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-7947a85f-36f4-4921-a25d-1858541cd380 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:16.515382 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-7947a85f-36f4-4921-a25d-1858541cd380 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:16.522865 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7947a85f-36f4-4921-a25d-1858541cd380 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:16.523310 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7947a85f-36f4-4921-a25d-1858541cd380 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:16.524075 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7947a85f-36f4-4921-a25d-1858541cd380 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:16.524507 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7947a85f-36f4-4921-a25d-1858541cd380 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:16.549882 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-7947a85f-36f4-4921-a25d-1858541cd380 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Going to try to terminate instance {{(pid=130058) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:45:16.861607 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-7947a85f-36f4-4921-a25d-1858541cd380 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 204 len: 0 microversion: 2.1 time: 0.349464 Jul 12 17:45:16.862658 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 403/818] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 12 17:45:16 2022] DELETE /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 17:45:16.868323 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-1e0da079-11f5-46f3-8476-3166cd3c46b1 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:16.869023 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-1e0da079-11f5-46f3-8476-3166cd3c46b1 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:16.876275 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1e0da079-11f5-46f3-8476-3166cd3c46b1 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:16.876731 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1e0da079-11f5-46f3-8476-3166cd3c46b1 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:16.877508 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1e0da079-11f5-46f3-8476-3166cd3c46b1 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:16.877941 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1e0da079-11f5-46f3-8476-3166cd3c46b1 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:16.946062 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-1e0da079-11f5-46f3-8476-3166cd3c46b1 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:16.953859 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-1e0da079-11f5-46f3-8476-3166cd3c46b1 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1241 microversion: 2.1 time: 0.089804 Jul 12 17:45:16.954774 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 404/819] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:16 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:16.959113 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-4132cf26-2421-4621-a389-fbf6d5bc2799 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:16.960944 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-4132cf26-2421-4621-a389-fbf6d5bc2799 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:16.967385 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-72049b8f-93f4-402c-bc08-1a31909d31e4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.125562 Jul 12 17:45:16.967927 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4132cf26-2421-4621-a389-fbf6d5bc2799 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:16.969607 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4132cf26-2421-4621-a389-fbf6d5bc2799 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:16.969745 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 416/820] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 12 17:45:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 17:45:16.969835 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4132cf26-2421-4621-a389-fbf6d5bc2799 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:16.969979 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4132cf26-2421-4621-a389-fbf6d5bc2799 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:16.979094 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-71fb89de-2afa-494c-a2a6-70f070478dc1 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:16.980018 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-71fb89de-2afa-494c-a2a6-70f070478dc1 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: ca00771c-f3e8-47de-aafc-9eb8a1a785b1] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:17.045646 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-71fb89de-2afa-494c-a2a6-70f070478dc1 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:17.055377 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-71fb89de-2afa-494c-a2a6-70f070478dc1 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1" status: 200 len: 1094 microversion: 2.1 time: 0.080576 Jul 12 17:45:17.059195 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 417/821] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:16 2022] GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1 => generated 1094 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:45:17.065586 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-3a1f5906-c827-4cdb-b64c-20083b0c87ad tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:17.066362 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-3a1f5906-c827-4cdb-b64c-20083b0c87ad tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:17.074251 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3a1f5906-c827-4cdb-b64c-20083b0c87ad tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:17.074814 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3a1f5906-c827-4cdb-b64c-20083b0c87ad tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:17.076101 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3a1f5906-c827-4cdb-b64c-20083b0c87ad tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:17.076620 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3a1f5906-c827-4cdb-b64c-20083b0c87ad tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:17.147729 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-4132cf26-2421-4621-a389-fbf6d5bc2799 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:17.155507 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-4132cf26-2421-4621-a389-fbf6d5bc2799 tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1554 microversion: 2.1 time: 0.199934 Jul 12 17:45:17.156228 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 405/822] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:16 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1554 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:17.236986 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-3a1f5906-c827-4cdb-b64c-20083b0c87ad tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:17.245827 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-3a1f5906-c827-4cdb-b64c-20083b0c87ad tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:17.247385 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-3a1f5906-c827-4cdb-b64c-20083b0c87ad tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:17.248554 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-3a1f5906-c827-4cdb-b64c-20083b0c87ad tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1722 microversion: 2.20 time: 0.188112 Jul 12 17:45:17.249115 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 418/823] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:17 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:45:17.972211 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-e42c2ccb-7342-4f18-98db-11076012e4e2 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:17.972846 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-e42c2ccb-7342-4f18-98db-11076012e4e2 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:17.980227 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e42c2ccb-7342-4f18-98db-11076012e4e2 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:17.980680 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e42c2ccb-7342-4f18-98db-11076012e4e2 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:17.981444 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e42c2ccb-7342-4f18-98db-11076012e4e2 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:17.981874 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e42c2ccb-7342-4f18-98db-11076012e4e2 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:18.046695 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-e42c2ccb-7342-4f18-98db-11076012e4e2 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:18.055165 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-e42c2ccb-7342-4f18-98db-11076012e4e2 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1233 microversion: 2.1 time: 0.086956 Jul 12 17:45:18.055737 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 406/824] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:17 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1233 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:18.072932 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-5fb63398-39ae-4a47-abbb-6b1d4f4d2f10 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:18.073733 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-5fb63398-39ae-4a47-abbb-6b1d4f4d2f10 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: ca00771c-f3e8-47de-aafc-9eb8a1a785b1] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:18.080576 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5fb63398-39ae-4a47-abbb-6b1d4f4d2f10 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:18.081029 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5fb63398-39ae-4a47-abbb-6b1d4f4d2f10 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:18.081812 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5fb63398-39ae-4a47-abbb-6b1d4f4d2f10 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:18.082351 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5fb63398-39ae-4a47-abbb-6b1d4f4d2f10 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:18.146746 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-5fb63398-39ae-4a47-abbb-6b1d4f4d2f10 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:18.155053 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-5fb63398-39ae-4a47-abbb-6b1d4f4d2f10 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1" status: 200 len: 1144 microversion: 2.1 time: 0.086435 Jul 12 17:45:18.155617 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 419/825] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:18 2022] GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1 => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:18.174131 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-267887d6-e765-451a-ab33-bdadfc3e168b tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:18.174776 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-267887d6-e765-451a-ab33-bdadfc3e168b tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:18.181257 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-267887d6-e765-451a-ab33-bdadfc3e168b tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:18.181702 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-267887d6-e765-451a-ab33-bdadfc3e168b tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:18.182505 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-267887d6-e765-451a-ab33-bdadfc3e168b tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:18.182943 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-267887d6-e765-451a-ab33-bdadfc3e168b tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:18.267917 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-509bc728-1133-40c2-8765-c681a79ec2a4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:18.268683 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-509bc728-1133-40c2-8765-c681a79ec2a4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:18.277445 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-509bc728-1133-40c2-8765-c681a79ec2a4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:18.277901 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-509bc728-1133-40c2-8765-c681a79ec2a4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:18.278716 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-509bc728-1133-40c2-8765-c681a79ec2a4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:18.279160 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-509bc728-1133-40c2-8765-c681a79ec2a4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:18.317978 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-267887d6-e765-451a-ab33-bdadfc3e168b tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:18.326734 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-267887d6-e765-451a-ab33-bdadfc3e168b tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1554 microversion: 2.1 time: 0.156357 Jul 12 17:45:18.327291 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 407/826] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:18 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:18.414295 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-509bc728-1133-40c2-8765-c681a79ec2a4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:18.422558 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-509bc728-1133-40c2-8765-c681a79ec2a4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:18.424079 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-509bc728-1133-40c2-8765-c681a79ec2a4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:18.425245 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-509bc728-1133-40c2-8765-c681a79ec2a4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1722 microversion: 2.20 time: 0.161742 Jul 12 17:45:18.425802 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 420/827] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:18 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:45:19.073730 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-849978fd-36ef-403c-8faa-4cae698b04cd tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:19.074342 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-849978fd-36ef-403c-8faa-4cae698b04cd tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:19.081485 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-849978fd-36ef-403c-8faa-4cae698b04cd tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:19.081941 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-849978fd-36ef-403c-8faa-4cae698b04cd tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:19.082769 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-849978fd-36ef-403c-8faa-4cae698b04cd tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:19.083208 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-849978fd-36ef-403c-8faa-4cae698b04cd tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:19.177644 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-2de04c95-5b4e-47d1-9e76-0eac06131451 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:19.178859 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-2de04c95-5b4e-47d1-9e76-0eac06131451 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: ca00771c-f3e8-47de-aafc-9eb8a1a785b1] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:19.191317 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2de04c95-5b4e-47d1-9e76-0eac06131451 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:19.192113 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2de04c95-5b4e-47d1-9e76-0eac06131451 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:19.193498 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2de04c95-5b4e-47d1-9e76-0eac06131451 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:19.194737 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2de04c95-5b4e-47d1-9e76-0eac06131451 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:19.268643 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-2de04c95-5b4e-47d1-9e76-0eac06131451 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:19.277260 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-2de04c95-5b4e-47d1-9e76-0eac06131451 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1" status: 200 len: 1136 microversion: 2.1 time: 0.107203 Jul 12 17:45:19.277848 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 421/828] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:19 2022] GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1 => generated 1136 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:19.308392 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-849978fd-36ef-403c-8faa-4cae698b04cd tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:19.322128 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-849978fd-36ef-403c-8faa-4cae698b04cd tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1289 microversion: 2.1 time: 0.251634 Jul 12 17:45:19.331097 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 408/829] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:19 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1289 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:19.344819 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-44e45948-4fea-4ee9-a76c-619c051a1d6c tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:19.345447 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-44e45948-4fea-4ee9-a76c-619c051a1d6c tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:19.353275 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-44e45948-4fea-4ee9-a76c-619c051a1d6c tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:19.353912 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-44e45948-4fea-4ee9-a76c-619c051a1d6c tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:19.354903 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-44e45948-4fea-4ee9-a76c-619c051a1d6c tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:19.355314 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-44e45948-4fea-4ee9-a76c-619c051a1d6c tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:19.444474 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-ab598655-9c3b-4fe5-89b1-519255422020 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:19.445581 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-ab598655-9c3b-4fe5-89b1-519255422020 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:19.452391 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ab598655-9c3b-4fe5-89b1-519255422020 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:19.453185 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ab598655-9c3b-4fe5-89b1-519255422020 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:19.454186 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ab598655-9c3b-4fe5-89b1-519255422020 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:19.454822 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ab598655-9c3b-4fe5-89b1-519255422020 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:19.602228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-44e45948-4fea-4ee9-a76c-619c051a1d6c tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:19.613729 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-44e45948-4fea-4ee9-a76c-619c051a1d6c tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1554 microversion: 2.1 time: 0.273517 Jul 12 17:45:19.614857 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 422/830] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:19 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1554 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:19.671036 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ab598655-9c3b-4fe5-89b1-519255422020 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:19.679489 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ab598655-9c3b-4fe5-89b1-519255422020 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:19.681278 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ab598655-9c3b-4fe5-89b1-519255422020 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:19.682713 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-ab598655-9c3b-4fe5-89b1-519255422020 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1722 microversion: 2.20 time: 0.242445 Jul 12 17:45:19.683264 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 409/831] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:19 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:45:19.919749 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-1975e755-447f-4399-a166-59d5a16eb00a req-7125ee22-07ca-4c3b-8da7-698a0671854c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d57de92-32ca-4ff9-a5ea-00d7e83bbf72", "name": "network-vif-deleted", "tag": "c4901ed1-f277-462c-b8b5-c19838c33e73"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:45:19.940237 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-1975e755-447f-4399-a166-59d5a16eb00a req-7125ee22-07ca-4c3b-8da7-698a0671854c service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:19.941120 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-1975e755-447f-4399-a166-59d5a16eb00a req-7125ee22-07ca-4c3b-8da7-698a0671854c service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:19.961323 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-1975e755-447f-4399-a166-59d5a16eb00a req-7125ee22-07ca-4c3b-8da7-698a0671854c service nova] Creating event network-vif-deleted:c4901ed1-f277-462c-b8b5-c19838c33e73 for instance 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 on hv-cinder-84875 Jul 12 17:45:19.967032 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-1975e755-447f-4399-a166-59d5a16eb00a req-7125ee22-07ca-4c3b-8da7-698a0671854c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053428 Jul 12 17:45:19.967633 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 423/832] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:45:20.294533 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-bc740a95-8c3f-4fae-aef6-5ce6995061b2 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:20.295328 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-bc740a95-8c3f-4fae-aef6-5ce6995061b2 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: ca00771c-f3e8-47de-aafc-9eb8a1a785b1] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:20.301868 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bc740a95-8c3f-4fae-aef6-5ce6995061b2 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:20.304097 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bc740a95-8c3f-4fae-aef6-5ce6995061b2 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:20.304776 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bc740a95-8c3f-4fae-aef6-5ce6995061b2 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:20.305437 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bc740a95-8c3f-4fae-aef6-5ce6995061b2 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:20.328638 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell0:SELECT=4 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:45:20.342142 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-b262f11c-79bf-4f7d-8cf5-16ec64d2d14b tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:20.344109 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-b262f11c-79bf-4f7d-8cf5-16ec64d2d14b tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:20.352189 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b262f11c-79bf-4f7d-8cf5-16ec64d2d14b tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:20.353464 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b262f11c-79bf-4f7d-8cf5-16ec64d2d14b tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:20.354955 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b262f11c-79bf-4f7d-8cf5-16ec64d2d14b tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:20.355704 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b262f11c-79bf-4f7d-8cf5-16ec64d2d14b tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:20.430200 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-bc740a95-8c3f-4fae-aef6-5ce6995061b2 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:20.441903 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-bc740a95-8c3f-4fae-aef6-5ce6995061b2 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1" status: 200 len: 1200 microversion: 2.1 time: 0.151553 Jul 12 17:45:20.447958 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 410/833] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:20 2022] GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1 => generated 1200 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:20.490042 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-b262f11c-79bf-4f7d-8cf5-16ec64d2d14b tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:20.499217 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-b262f11c-79bf-4f7d-8cf5-16ec64d2d14b tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1295 microversion: 2.1 time: 0.162983 Jul 12 17:45:20.499811 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 424/834] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:20 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1295 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:20.637224 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-3ced2df3-db03-4ea7-b7a4-ebdf26a417ad tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:20.637872 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-3ced2df3-db03-4ea7-b7a4-ebdf26a417ad tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:20.644159 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3ced2df3-db03-4ea7-b7a4-ebdf26a417ad tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:20.644604 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3ced2df3-db03-4ea7-b7a4-ebdf26a417ad tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:20.645371 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3ced2df3-db03-4ea7-b7a4-ebdf26a417ad tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:20.645909 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3ced2df3-db03-4ea7-b7a4-ebdf26a417ad tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:20.678561 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3ced2df3-db03-4ea7-b7a4-ebdf26a417ad tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:20.679013 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3ced2df3-db03-4ea7-b7a4-ebdf26a417ad tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:20.679470 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.objects.instance [None req-3ced2df3-db03-4ea7-b7a4-ebdf26a417ad tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lazy-loading 'fault' on Instance uuid 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 {{(pid=130058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:45:20.705561 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-c208a54d-ca4f-4013-88dc-c1dfb2326278 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:20.706301 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-c208a54d-ca4f-4013-88dc-c1dfb2326278 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:20.714207 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c208a54d-ca4f-4013-88dc-c1dfb2326278 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:20.714993 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c208a54d-ca4f-4013-88dc-c1dfb2326278 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:20.715778 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c208a54d-ca4f-4013-88dc-c1dfb2326278 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:20.716358 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c208a54d-ca4f-4013-88dc-c1dfb2326278 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:20.751427 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-3ced2df3-db03-4ea7-b7a4-ebdf26a417ad tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed4726967dd844b692fa7badd510267a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80285308991b47308701fd3363bec122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:20.777429 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-3ced2df3-db03-4ea7-b7a4-ebdf26a417ad tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 200 len: 1347 microversion: 2.1 time: 0.144141 Jul 12 17:45:20.784197 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 411/835] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:20 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 1347 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:20.872538 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-c208a54d-ca4f-4013-88dc-c1dfb2326278 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:20.881592 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-c208a54d-ca4f-4013-88dc-c1dfb2326278 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:20.883174 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-c208a54d-ca4f-4013-88dc-c1dfb2326278 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:20.885896 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-c208a54d-ca4f-4013-88dc-c1dfb2326278 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1722 microversion: 2.20 time: 0.187291 Jul 12 17:45:20.886815 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 425/836] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:20 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:45:21.460066 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-11adc719-be5f-4f0e-abb6-64b2aa6db46e tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:21.460699 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-11adc719-be5f-4f0e-abb6-64b2aa6db46e tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: ca00771c-f3e8-47de-aafc-9eb8a1a785b1] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:21.467599 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-11adc719-be5f-4f0e-abb6-64b2aa6db46e tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:21.468141 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-11adc719-be5f-4f0e-abb6-64b2aa6db46e tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:21.469015 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-11adc719-be5f-4f0e-abb6-64b2aa6db46e tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:21.469518 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-11adc719-be5f-4f0e-abb6-64b2aa6db46e tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:21.516327 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-7574c5e7-8a1b-4676-b351-0eceb199e10c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:21.517040 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-7574c5e7-8a1b-4676-b351-0eceb199e10c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:21.523846 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7574c5e7-8a1b-4676-b351-0eceb199e10c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:21.524298 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7574c5e7-8a1b-4676-b351-0eceb199e10c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:21.525139 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7574c5e7-8a1b-4676-b351-0eceb199e10c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:21.525603 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7574c5e7-8a1b-4676-b351-0eceb199e10c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:21.717126 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-11adc719-be5f-4f0e-abb6-64b2aa6db46e tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:21.729779 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-11adc719-be5f-4f0e-abb6-64b2aa6db46e tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1" status: 200 len: 1278 microversion: 2.1 time: 0.273617 Jul 12 17:45:21.733238 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 412/837] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:21 2022] GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1 => generated 1278 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:21.781518 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-7574c5e7-8a1b-4676-b351-0eceb199e10c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:21.789501 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-7574c5e7-8a1b-4676-b351-0eceb199e10c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1362 microversion: 2.1 time: 0.277042 Jul 12 17:45:21.799920 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 426/838] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:21 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:45:21.804747 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-3146d807-aafd-4d80-8785-de94acff762a tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:21.805637 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-3146d807-aafd-4d80-8785-de94acff762a tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] [instance: 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:21.813532 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3146d807-aafd-4d80-8785-de94acff762a tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:21.818923 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3146d807-aafd-4d80-8785-de94acff762a tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:21.818923 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3146d807-aafd-4d80-8785-de94acff762a tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:21.818923 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3146d807-aafd-4d80-8785-de94acff762a tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:21.833742 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.wsgi [None req-3146d807-aafd-4d80-8785-de94acff762a tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] HTTP exception thrown: Instance 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 could not be found. Jul 12 17:45:21.835502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-3146d807-aafd-4d80-8785-de94acff762a tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Request method failure captured: Jul 12 17:45:21.835502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: request: GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 HTTP/1.1 Jul 12 17:45:21.835502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept: application/json Jul 12 17:45:21.835502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept-Encoding: identity Jul 12 17:45:21.835502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Connection: close Jul 12 17:45:21.835502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Length: 0 Jul 12 17:45:21.835502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Type: application/json Jul 12 17:45:21.835502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Host: 10.222.0.16 Jul 12 17:45:21.835502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Openstack-System-Scope: None Jul 12 17:45:21.835502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: User-Agent: python-urllib3/1.26.9 Jul 12 17:45:21.835502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Auth-Token: gAAAAABizbJt-2o7qoeS3bSHwuy0n3ICAf6xXbVwFC0svMc_dx0mm4y9DNhFJiHsWmdoWjBhhsI3cWjgHd9uSQi7x9cdSYzHKUTjC-wL-awmqTdm9LufDgbkdZ_fC2S4xssOfHTiQUQMF1w0krAqAxUu8S8zDS2MxtMRrzPiLgaL3ApJ7cl_weo Jul 12 17:45:21.835502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Id: None Jul 12 17:45:21.835502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Name: None Jul 12 17:45:21.835502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Identity-Status: Confirmed Jul 12 17:45:21.835502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Is-Admin-Project: True Jul 12 17:45:21.835502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Id: default Jul 12 17:45:21.835502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Name: Default Jul 12 17:45:21.835502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Id: 80285308991b47308701fd3363bec122 Jul 12 17:45:21.835502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Name: tempest-TestMinimumBasicScenario-1474592602 Jul 12 17:45:21.835502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Role: reader,member Jul 12 17:45:21.835502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Roles: reader,member Jul 12 17:45:21.837958 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80285308991b47308701fd3363bec122"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_80285308991b47308701fd3363bec122", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80285308991b47308701fd3363bec122"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/80285308991b47308701fd3363bec122"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:45:21.837958 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant: tempest-TestMinimumBasicScenario-1474592602 Jul 12 17:45:21.837958 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Id: 80285308991b47308701fd3363bec122 Jul 12 17:45:21.837958 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1474592602 Jul 12 17:45:21.837958 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User: tempest-TestMinimumBasicScenario-1474592602-project Jul 12 17:45:21.837958 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Id: default Jul 12 17:45:21.837958 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Name: Default Jul 12 17:45:21.837958 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Id: ed4726967dd844b692fa7badd510267a Jul 12 17:45:21.837958 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Name: tempest-TestMinimumBasicScenario-1474592602-project Jul 12 17:45:21.837958 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: method: > Jul 12 17:45:21.837958 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: exception: Instance 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 could not be found. Jul 12 17:45:21.837958 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: action_args: {'id': '4d57de92-32ca-4ff9-a5ea-00d7e83bbf72'} Jul 12 17:45:21.839474 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:45:21.839474 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:45:21.839474 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:45:21.839474 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:45:21.839474 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:45:21.839474 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:45:21.839474 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:45:21.839474 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:45:21.839474 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:45:21.839474 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:45:21.839474 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 could not be found. Jul 12 17:45:21.839474 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:45:21.839474 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:45:21.839474 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:45:21.839474 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:45:21.839474 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:45:21.839474 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:45:21.839474 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:45:21.839474 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:45:21.839474 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:45:21.840757 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:45:21.840757 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:45:21.840757 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:45:21.840757 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:45:21.840757 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:45:21.840757 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:45:21.840757 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:45:21.840757 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 could not be found. Jul 12 17:45:21.840757 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:45:21.840757 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:45:21.840757 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:45:21.840757 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:45:21.840757 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:45:21.840757 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:45:21.840757 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:45:21.840757 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:45:21.840757 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 could not be found. Jul 12 17:45:21.840757 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:45:21.841827 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-3146d807-aafd-4d80-8785-de94acff762a tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Returning 404 to user: Instance 4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 could not be found. {{(pid=130058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:45:21.841827 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-3146d807-aafd-4d80-8785-de94acff762a tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72" status: 404 len: 111 microversion: 2.1 time: 0.037638 Jul 12 17:45:21.841827 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 413/839] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:21 2022] GET /compute/v2.1/servers/4d57de92-32ca-4ff9-a5ea-00d7e83bbf72 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 17:45:21.853438 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-1b3a9d94-89b3-43d7-a684-01a25292100a tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] Calling method '.version_select at 0x7f479fbe4f70>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:21.907207 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-2ec67c55-49b0-452b-a536-dc39c672b786 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:21.909230 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-2ec67c55-49b0-452b-a536-dc39c672b786 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:21.918941 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2ec67c55-49b0-452b-a536-dc39c672b786 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:21.919512 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2ec67c55-49b0-452b-a536-dc39c672b786 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:21.920748 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2ec67c55-49b0-452b-a536-dc39c672b786 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:21.921322 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2ec67c55-49b0-452b-a536-dc39c672b786 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:21.953899 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-1b3a9d94-89b3-43d7-a684-01a25292100a tempest-TestMinimumBasicScenario-1474592602 tempest-TestMinimumBasicScenario-1474592602-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-401296661" status: 202 len: 0 microversion: 2.1 time: 0.108606 Jul 12 17:45:21.955098 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 427/840] 10.222.0.16 () {58 vars in 1268 bytes} [Tue Jul 12 17:45:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-401296661 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:45:22.078805 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-b75adb84-fa9d-42fa-98f8-02846dbbd9b5 req-94ede8dc-c3c8-47f1-bda7-db9bd7f04fea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8f7b428-9b6d-459f-8ad2-cab4f82052e8", "tag": "4aa2bfdc-7ea3-4238-b47f-3803e818647e"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:45:22.106263 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-b75adb84-fa9d-42fa-98f8-02846dbbd9b5 req-94ede8dc-c3c8-47f1-bda7-db9bd7f04fea service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:22.108071 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-b75adb84-fa9d-42fa-98f8-02846dbbd9b5 req-94ede8dc-c3c8-47f1-bda7-db9bd7f04fea service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:22.124485 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-b75adb84-fa9d-42fa-98f8-02846dbbd9b5 req-94ede8dc-c3c8-47f1-bda7-db9bd7f04fea service nova] Creating event network-changed:4aa2bfdc-7ea3-4238-b47f-3803e818647e for instance c8f7b428-9b6d-459f-8ad2-cab4f82052e8 on hv-cinder-84875 Jul 12 17:45:22.145223 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-b75adb84-fa9d-42fa-98f8-02846dbbd9b5 req-94ede8dc-c3c8-47f1-bda7-db9bd7f04fea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071696 Jul 12 17:45:22.147030 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 428/841] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:45:22.230899 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-2ec67c55-49b0-452b-a536-dc39c672b786 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:22.239721 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-2ec67c55-49b0-452b-a536-dc39c672b786 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:22.241748 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-2ec67c55-49b0-452b-a536-dc39c672b786 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:22.242970 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-2ec67c55-49b0-452b-a536-dc39c672b786 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1722 microversion: 2.20 time: 0.341209 Jul 12 17:45:22.243864 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 414/842] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:21 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1722 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:45:22.752727 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-8a3e5456-1c59-4200-895f-464d846d6b6a tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:22.753628 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-8a3e5456-1c59-4200-895f-464d846d6b6a tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: ca00771c-f3e8-47de-aafc-9eb8a1a785b1] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:22.767580 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8a3e5456-1c59-4200-895f-464d846d6b6a tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:22.768115 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8a3e5456-1c59-4200-895f-464d846d6b6a tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:22.769132 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8a3e5456-1c59-4200-895f-464d846d6b6a tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:22.769662 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8a3e5456-1c59-4200-895f-464d846d6b6a tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:22.812677 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-67e5cc1b-7f6e-4c97-8a41-4d3dc1f09ac6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:22.814999 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-67e5cc1b-7f6e-4c97-8a41-4d3dc1f09ac6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:22.827998 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-67e5cc1b-7f6e-4c97-8a41-4d3dc1f09ac6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:22.828801 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-67e5cc1b-7f6e-4c97-8a41-4d3dc1f09ac6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:22.830381 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-67e5cc1b-7f6e-4c97-8a41-4d3dc1f09ac6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:22.831581 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-67e5cc1b-7f6e-4c97-8a41-4d3dc1f09ac6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:23.015936 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-67e5cc1b-7f6e-4c97-8a41-4d3dc1f09ac6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:23.025068 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-67e5cc1b-7f6e-4c97-8a41-4d3dc1f09ac6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1362 microversion: 2.1 time: 0.221396 Jul 12 17:45:23.025650 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 415/843] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:22 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:45:23.037824 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-8a3e5456-1c59-4200-895f-464d846d6b6a tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:23.057779 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-8a3e5456-1c59-4200-895f-464d846d6b6a tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1" status: 200 len: 1266 microversion: 2.1 time: 0.302145 Jul 12 17:45:23.057779 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 429/844] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:22 2022] GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1 => generated 1266 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:23.065879 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-84b8a714-aa9f-40a7-9967-0ee02c27fb25 req-3a64e683-ce26-47b2-86d2-ad7288ae5818 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca00771c-f3e8-47de-aafc-9eb8a1a785b1", "tag": "78739528-de51-4c99-820c-5e39ced35a39"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:45:23.076762 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-84b8a714-aa9f-40a7-9967-0ee02c27fb25 req-3a64e683-ce26-47b2-86d2-ad7288ae5818 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:23.077442 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-84b8a714-aa9f-40a7-9967-0ee02c27fb25 req-3a64e683-ce26-47b2-86d2-ad7288ae5818 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:23.097097 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-84b8a714-aa9f-40a7-9967-0ee02c27fb25 req-3a64e683-ce26-47b2-86d2-ad7288ae5818 service nova] Creating event network-changed:78739528-de51-4c99-820c-5e39ced35a39 for instance ca00771c-f3e8-47de-aafc-9eb8a1a785b1 on hv-cinder-84875 Jul 12 17:45:23.103715 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-84b8a714-aa9f-40a7-9967-0ee02c27fb25 req-3a64e683-ce26-47b2-86d2-ad7288ae5818 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076637 Jul 12 17:45:23.104567 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 416/845] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:45:23.262976 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-e743ddc4-f332-430f-bdbb-c519192e1be1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:23.263510 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-e743ddc4-f332-430f-bdbb-c519192e1be1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:23.269742 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e743ddc4-f332-430f-bdbb-c519192e1be1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:23.270235 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e743ddc4-f332-430f-bdbb-c519192e1be1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:23.271049 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e743ddc4-f332-430f-bdbb-c519192e1be1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:23.271492 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e743ddc4-f332-430f-bdbb-c519192e1be1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:23.411407 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-e743ddc4-f332-430f-bdbb-c519192e1be1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:23.420629 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-e743ddc4-f332-430f-bdbb-c519192e1be1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:23.422480 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-e743ddc4-f332-430f-bdbb-c519192e1be1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:23.424027 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-e743ddc4-f332-430f-bdbb-c519192e1be1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1722 microversion: 2.20 time: 0.165858 Jul 12 17:45:23.434879 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 430/846] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:23 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:45:24.043007 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-c83e08a6-6873-40a7-85a1-7b27da832a80 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:24.044325 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-c83e08a6-6873-40a7-85a1-7b27da832a80 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:24.050810 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c83e08a6-6873-40a7-85a1-7b27da832a80 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:24.051429 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c83e08a6-6873-40a7-85a1-7b27da832a80 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:24.052207 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c83e08a6-6873-40a7-85a1-7b27da832a80 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:24.052649 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c83e08a6-6873-40a7-85a1-7b27da832a80 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:24.073819 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-00fe0130-2208-4585-b02c-b0922ffae0b7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:24.074450 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-00fe0130-2208-4585-b02c-b0922ffae0b7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: ca00771c-f3e8-47de-aafc-9eb8a1a785b1] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:24.077160 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:45:24.087685 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-00fe0130-2208-4585-b02c-b0922ffae0b7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:24.087685 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-00fe0130-2208-4585-b02c-b0922ffae0b7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:24.087685 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-00fe0130-2208-4585-b02c-b0922ffae0b7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:24.087685 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-00fe0130-2208-4585-b02c-b0922ffae0b7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:24.270857 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-c83e08a6-6873-40a7-85a1-7b27da832a80 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:24.276104 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:45:24.282360 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-c83e08a6-6873-40a7-85a1-7b27da832a80 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1362 microversion: 2.1 time: 0.244814 Jul 12 17:45:24.282984 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 417/847] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:24 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:24.324962 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-00fe0130-2208-4585-b02c-b0922ffae0b7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:24.333216 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-00fe0130-2208-4585-b02c-b0922ffae0b7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1" status: 200 len: 1266 microversion: 2.1 time: 0.263172 Jul 12 17:45:24.333814 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 431/848] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:24 2022] GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1 => generated 1266 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:24.446305 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-38127be0-4ea9-4dbd-9b77-695c77546434 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:24.446993 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-38127be0-4ea9-4dbd-9b77-695c77546434 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:24.453517 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-38127be0-4ea9-4dbd-9b77-695c77546434 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:24.453974 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-38127be0-4ea9-4dbd-9b77-695c77546434 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:24.454935 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-38127be0-4ea9-4dbd-9b77-695c77546434 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:24.455377 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-38127be0-4ea9-4dbd-9b77-695c77546434 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:24.599935 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-38127be0-4ea9-4dbd-9b77-695c77546434 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:24.609260 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-38127be0-4ea9-4dbd-9b77-695c77546434 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:24.610840 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-38127be0-4ea9-4dbd-9b77-695c77546434 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:24.612925 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-38127be0-4ea9-4dbd-9b77-695c77546434 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1722 microversion: 2.20 time: 0.171590 Jul 12 17:45:24.613776 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 418/849] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:24 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:45:25.300367 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-b7a967a6-8bb6-4851-b0fc-7ad5667da551 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:25.301058 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-b7a967a6-8bb6-4851-b0fc-7ad5667da551 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:25.308349 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b7a967a6-8bb6-4851-b0fc-7ad5667da551 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:25.308804 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b7a967a6-8bb6-4851-b0fc-7ad5667da551 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:25.309584 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b7a967a6-8bb6-4851-b0fc-7ad5667da551 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:25.310027 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b7a967a6-8bb6-4851-b0fc-7ad5667da551 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:25.351220 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-98de9fcf-3a8d-4dd8-b002-87fed97ef89c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:25.351839 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-98de9fcf-3a8d-4dd8-b002-87fed97ef89c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: ca00771c-f3e8-47de-aafc-9eb8a1a785b1] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:25.359810 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-98de9fcf-3a8d-4dd8-b002-87fed97ef89c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:25.360272 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-98de9fcf-3a8d-4dd8-b002-87fed97ef89c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:25.361060 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-98de9fcf-3a8d-4dd8-b002-87fed97ef89c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:25.361502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-98de9fcf-3a8d-4dd8-b002-87fed97ef89c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:25.515011 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-98de9fcf-3a8d-4dd8-b002-87fed97ef89c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:25.522837 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-98de9fcf-3a8d-4dd8-b002-87fed97ef89c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1" status: 200 len: 1266 microversion: 2.1 time: 0.175828 Jul 12 17:45:25.523834 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 419/850] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:25 2022] GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:25.563455 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-b7a967a6-8bb6-4851-b0fc-7ad5667da551 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:25.573319 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-b7a967a6-8bb6-4851-b0fc-7ad5667da551 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1362 microversion: 2.1 time: 0.276578 Jul 12 17:45:25.583733 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 432/851] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:25 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:25.631797 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-9b54bea4-3416-4181-b657-fece8bc29dd1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:25.632526 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-9b54bea4-3416-4181-b657-fece8bc29dd1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:25.639606 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9b54bea4-3416-4181-b657-fece8bc29dd1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:25.640227 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9b54bea4-3416-4181-b657-fece8bc29dd1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:25.640908 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9b54bea4-3416-4181-b657-fece8bc29dd1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:25.641351 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9b54bea4-3416-4181-b657-fece8bc29dd1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:25.796887 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-9b54bea4-3416-4181-b657-fece8bc29dd1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:25.805620 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-9b54bea4-3416-4181-b657-fece8bc29dd1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:25.807683 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-9b54bea4-3416-4181-b657-fece8bc29dd1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:25.808909 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-9b54bea4-3416-4181-b657-fece8bc29dd1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1722 microversion: 2.20 time: 0.181243 Jul 12 17:45:25.809469 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 420/852] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:25 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:45:26.541165 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-6167016f-9b5e-4798-9809-994f2bfd818b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:26.541986 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-6167016f-9b5e-4798-9809-994f2bfd818b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: ca00771c-f3e8-47de-aafc-9eb8a1a785b1] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:26.544786 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell0:SELECT=4 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:45:26.549847 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6167016f-9b5e-4798-9809-994f2bfd818b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:26.550297 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6167016f-9b5e-4798-9809-994f2bfd818b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:26.551144 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6167016f-9b5e-4798-9809-994f2bfd818b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:26.551585 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6167016f-9b5e-4798-9809-994f2bfd818b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:26.557632 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=100 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:45:26.590964 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-848df3be-11ba-43bb-8e4e-7630906b4582 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:26.591593 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-848df3be-11ba-43bb-8e4e-7630906b4582 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:26.600894 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-848df3be-11ba-43bb-8e4e-7630906b4582 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:26.601904 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-848df3be-11ba-43bb-8e4e-7630906b4582 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:26.604341 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-848df3be-11ba-43bb-8e4e-7630906b4582 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:26.605272 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-848df3be-11ba-43bb-8e4e-7630906b4582 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:26.745946 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-6167016f-9b5e-4798-9809-994f2bfd818b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:26.763143 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-6167016f-9b5e-4798-9809-994f2bfd818b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1" status: 200 len: 1266 microversion: 2.1 time: 0.226627 Jul 12 17:45:26.769242 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 433/853] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:26 2022] GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:45:26.831731 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ccbac536-d1f4-4c70-96e4-c82ddd88a1fd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:26.832684 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-ccbac536-d1f4-4c70-96e4-c82ddd88a1fd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:26.841800 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ccbac536-d1f4-4c70-96e4-c82ddd88a1fd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:26.842464 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ccbac536-d1f4-4c70-96e4-c82ddd88a1fd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:26.844212 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ccbac536-d1f4-4c70-96e4-c82ddd88a1fd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:26.844953 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ccbac536-d1f4-4c70-96e4-c82ddd88a1fd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:26.894200 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-848df3be-11ba-43bb-8e4e-7630906b4582 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:26.903096 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-848df3be-11ba-43bb-8e4e-7630906b4582 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1362 microversion: 2.1 time: 0.315865 Jul 12 17:45:26.912552 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 421/854] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:26 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1362 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:27.009858 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-ccbac536-d1f4-4c70-96e4-c82ddd88a1fd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:27.020356 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-ccbac536-d1f4-4c70-96e4-c82ddd88a1fd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:27.022135 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-ccbac536-d1f4-4c70-96e4-c82ddd88a1fd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:27.023620 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-ccbac536-d1f4-4c70-96e4-c82ddd88a1fd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1743 microversion: 2.20 time: 0.199143 Jul 12 17:45:27.024573 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 434/855] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:26 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1743 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:45:27.789228 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-146a2206-2047-4363-9508-4f94667b7ba8 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:27.789877 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-146a2206-2047-4363-9508-4f94667b7ba8 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: ca00771c-f3e8-47de-aafc-9eb8a1a785b1] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:27.798109 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-146a2206-2047-4363-9508-4f94667b7ba8 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:27.798595 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-146a2206-2047-4363-9508-4f94667b7ba8 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:27.799379 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-146a2206-2047-4363-9508-4f94667b7ba8 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:27.799817 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-146a2206-2047-4363-9508-4f94667b7ba8 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:27.924692 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-4b18305b-caea-4ba9-8014-135822c90e9c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:27.925321 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-4b18305b-caea-4ba9-8014-135822c90e9c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:27.927567 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell0:SELECT=16 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:45:27.934088 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4b18305b-caea-4ba9-8014-135822c90e9c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:27.934586 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4b18305b-caea-4ba9-8014-135822c90e9c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:27.935382 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4b18305b-caea-4ba9-8014-135822c90e9c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:27.935953 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4b18305b-caea-4ba9-8014-135822c90e9c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:27.951465 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-146a2206-2047-4363-9508-4f94667b7ba8 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:27.959499 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-146a2206-2047-4363-9508-4f94667b7ba8 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1" status: 200 len: 1266 microversion: 2.1 time: 0.174021 Jul 12 17:45:27.970221 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 422/856] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:27 2022] GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:28.045875 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-1e4820c2-419a-40d0-bc30-d30c01e8c393 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:28.047640 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-1e4820c2-419a-40d0-bc30-d30c01e8c393 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:28.053948 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1e4820c2-419a-40d0-bc30-d30c01e8c393 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:28.056827 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1e4820c2-419a-40d0-bc30-d30c01e8c393 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:28.056827 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1e4820c2-419a-40d0-bc30-d30c01e8c393 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:28.056827 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1e4820c2-419a-40d0-bc30-d30c01e8c393 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:28.162042 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-4b18305b-caea-4ba9-8014-135822c90e9c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:28.170258 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-4b18305b-caea-4ba9-8014-135822c90e9c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1362 microversion: 2.1 time: 0.252344 Jul 12 17:45:28.171229 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 435/857] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:27 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:28.197122 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-1e4820c2-419a-40d0-bc30-d30c01e8c393 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:28.205475 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-1e4820c2-419a-40d0-bc30-d30c01e8c393 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:28.207306 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-1e4820c2-419a-40d0-bc30-d30c01e8c393 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:28.208503 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-1e4820c2-419a-40d0-bc30-d30c01e8c393 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1743 microversion: 2.20 time: 0.166614 Jul 12 17:45:28.209069 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 423/858] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:28 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:45:28.980111 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-7d79e46a-86c8-4cdb-951f-c99438f68b16 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:28.980111 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-7d79e46a-86c8-4cdb-951f-c99438f68b16 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: ca00771c-f3e8-47de-aafc-9eb8a1a785b1] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:28.987024 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7d79e46a-86c8-4cdb-951f-c99438f68b16 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:28.987354 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7d79e46a-86c8-4cdb-951f-c99438f68b16 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:28.988130 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7d79e46a-86c8-4cdb-951f-c99438f68b16 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:28.988782 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7d79e46a-86c8-4cdb-951f-c99438f68b16 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:29.163968 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-ac99d8df-304f-4565-b065-b79a0c277f78 req-0ff8769a-ba12-4b78-98a8-0e7bb39ff7b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8f7b428-9b6d-459f-8ad2-cab4f82052e8", "name": "network-vif-plugged", "status": "completed", "tag": "4aa2bfdc-7ea3-4238-b47f-3803e818647e"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:45:29.173695 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-ac99d8df-304f-4565-b065-b79a0c277f78 req-0ff8769a-ba12-4b78-98a8-0e7bb39ff7b0 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:29.174119 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-ac99d8df-304f-4565-b065-b79a0c277f78 req-0ff8769a-ba12-4b78-98a8-0e7bb39ff7b0 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:29.187483 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-ac99d8df-304f-4565-b065-b79a0c277f78 req-0ff8769a-ba12-4b78-98a8-0e7bb39ff7b0 service nova] Creating event network-vif-plugged:4aa2bfdc-7ea3-4238-b47f-3803e818647e for instance c8f7b428-9b6d-459f-8ad2-cab4f82052e8 on hv-cinder-84875 Jul 12 17:45:29.192375 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-ac99d8df-304f-4565-b065-b79a0c277f78 req-0ff8769a-ba12-4b78-98a8-0e7bb39ff7b0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032374 Jul 12 17:45:29.193559 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 424/859] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:45:29.199539 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-c0481e3f-b42d-43c5-ba2d-5a9f671276ce tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:29.200236 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-c0481e3f-b42d-43c5-ba2d-5a9f671276ce tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:29.206873 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c0481e3f-b42d-43c5-ba2d-5a9f671276ce tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:29.207317 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c0481e3f-b42d-43c5-ba2d-5a9f671276ce tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:29.208429 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c0481e3f-b42d-43c5-ba2d-5a9f671276ce tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:29.208894 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c0481e3f-b42d-43c5-ba2d-5a9f671276ce tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:29.235221 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-7d79e46a-86c8-4cdb-951f-c99438f68b16 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:29.243499 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-7d79e46a-86c8-4cdb-951f-c99438f68b16 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1" status: 200 len: 1266 microversion: 2.1 time: 0.269479 Jul 12 17:45:29.247260 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 436/860] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:28 2022] GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1 => generated 1266 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:45:29.252214 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-05d3e8ba-eaea-4f53-99f1-53b3ca6bf2e5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:29.255353 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-05d3e8ba-eaea-4f53-99f1-53b3ca6bf2e5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:29.268366 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-05d3e8ba-eaea-4f53-99f1-53b3ca6bf2e5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:29.269216 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-05d3e8ba-eaea-4f53-99f1-53b3ca6bf2e5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:29.271093 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-05d3e8ba-eaea-4f53-99f1-53b3ca6bf2e5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:29.271722 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-05d3e8ba-eaea-4f53-99f1-53b3ca6bf2e5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:29.404457 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-c0481e3f-b42d-43c5-ba2d-5a9f671276ce tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:29.414116 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-c0481e3f-b42d-43c5-ba2d-5a9f671276ce tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1362 microversion: 2.1 time: 0.219012 Jul 12 17:45:29.414919 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 425/861] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:29 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:29.577041 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-05d3e8ba-eaea-4f53-99f1-53b3ca6bf2e5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:29.587110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-05d3e8ba-eaea-4f53-99f1-53b3ca6bf2e5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:29.588919 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-05d3e8ba-eaea-4f53-99f1-53b3ca6bf2e5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:29.590602 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-05d3e8ba-eaea-4f53-99f1-53b3ca6bf2e5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1743 microversion: 2.20 time: 0.341913 Jul 12 17:45:29.592037 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 437/862] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:29 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1743 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:45:30.263632 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-f8db993e-3522-4cbe-a5b1-d59591a6610c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:30.264229 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-f8db993e-3522-4cbe-a5b1-d59591a6610c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: ca00771c-f3e8-47de-aafc-9eb8a1a785b1] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:30.270722 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f8db993e-3522-4cbe-a5b1-d59591a6610c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:30.271174 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f8db993e-3522-4cbe-a5b1-d59591a6610c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:30.271952 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f8db993e-3522-4cbe-a5b1-d59591a6610c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:30.272375 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f8db993e-3522-4cbe-a5b1-d59591a6610c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:30.410599 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-f8db993e-3522-4cbe-a5b1-d59591a6610c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:30.418305 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-f8db993e-3522-4cbe-a5b1-d59591a6610c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1" status: 200 len: 1266 microversion: 2.1 time: 0.159492 Jul 12 17:45:30.418839 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 426/863] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:30 2022] GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:30.433183 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-8c73ab99-f573-4889-804b-9ed1f8a84f93 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:30.433805 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-8c73ab99-f573-4889-804b-9ed1f8a84f93 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:30.440440 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8c73ab99-f573-4889-804b-9ed1f8a84f93 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:30.440899 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8c73ab99-f573-4889-804b-9ed1f8a84f93 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:30.441677 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8c73ab99-f573-4889-804b-9ed1f8a84f93 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:30.442127 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8c73ab99-f573-4889-804b-9ed1f8a84f93 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:30.609287 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-50810c7c-fd02-4809-8d58-e9de468567e1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:30.609910 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-50810c7c-fd02-4809-8d58-e9de468567e1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:30.611707 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-8c73ab99-f573-4889-804b-9ed1f8a84f93 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:30.616764 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-50810c7c-fd02-4809-8d58-e9de468567e1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:30.617420 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-50810c7c-fd02-4809-8d58-e9de468567e1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:30.619318 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-50810c7c-fd02-4809-8d58-e9de468567e1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:30.620015 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-50810c7c-fd02-4809-8d58-e9de468567e1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:30.620828 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-8c73ab99-f573-4889-804b-9ed1f8a84f93 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1362 microversion: 2.1 time: 0.192077 Jul 12 17:45:30.623188 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 438/864] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:30 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:30.857149 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-50810c7c-fd02-4809-8d58-e9de468567e1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:30.869610 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-50810c7c-fd02-4809-8d58-e9de468567e1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:30.871187 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-50810c7c-fd02-4809-8d58-e9de468567e1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:30.872633 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-50810c7c-fd02-4809-8d58-e9de468567e1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1738 microversion: 2.20 time: 0.267542 Jul 12 17:45:30.885347 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 427/865] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:30 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1738 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:45:31.287066 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-9fff7fe8-e4fa-46b3-a56c-c65d7c3b813f req-fefd711a-bbf0-498b-84d2-5764024719e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ad3f97-288d-4704-ad33-35bc58e94dfe", "name": "network-vif-plugged", "status": "completed", "tag": "c8a33017-1571-46b3-8afd-ee6981b1ac07"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:45:31.301549 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-9fff7fe8-e4fa-46b3-a56c-c65d7c3b813f req-fefd711a-bbf0-498b-84d2-5764024719e5 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:31.302475 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-9fff7fe8-e4fa-46b3-a56c-c65d7c3b813f req-fefd711a-bbf0-498b-84d2-5764024719e5 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:31.329037 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-9fff7fe8-e4fa-46b3-a56c-c65d7c3b813f req-fefd711a-bbf0-498b-84d2-5764024719e5 service nova] Creating event network-vif-plugged:c8a33017-1571-46b3-8afd-ee6981b1ac07 for instance 07ad3f97-288d-4704-ad33-35bc58e94dfe on hv-cinder-84875 Jul 12 17:45:31.339119 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-9fff7fe8-e4fa-46b3-a56c-c65d7c3b813f req-fefd711a-bbf0-498b-84d2-5764024719e5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056062 Jul 12 17:45:31.340224 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 439/866] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:45:31.437301 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-a705e4b3-6d4c-4901-a104-8ed540d81d9a tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:31.439140 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-a705e4b3-6d4c-4901-a104-8ed540d81d9a tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: ca00771c-f3e8-47de-aafc-9eb8a1a785b1] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:31.453563 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a705e4b3-6d4c-4901-a104-8ed540d81d9a tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:31.458891 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a705e4b3-6d4c-4901-a104-8ed540d81d9a tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:31.459940 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a705e4b3-6d4c-4901-a104-8ed540d81d9a tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:31.466746 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a705e4b3-6d4c-4901-a104-8ed540d81d9a tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:31.647938 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-2a59a94d-890b-4fd6-ab5e-7e71504c5d68 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:31.650716 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-2a59a94d-890b-4fd6-ab5e-7e71504c5d68 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:31.669988 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2a59a94d-890b-4fd6-ab5e-7e71504c5d68 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:31.671256 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2a59a94d-890b-4fd6-ab5e-7e71504c5d68 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:31.672387 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2a59a94d-890b-4fd6-ab5e-7e71504c5d68 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:31.673031 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2a59a94d-890b-4fd6-ab5e-7e71504c5d68 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:31.718299 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-a705e4b3-6d4c-4901-a104-8ed540d81d9a tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:31.727205 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-a705e4b3-6d4c-4901-a104-8ed540d81d9a tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1" status: 200 len: 1266 microversion: 2.1 time: 0.293949 Jul 12 17:45:31.729737 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 428/867] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:31 2022] GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1 => generated 1266 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:45:31.893744 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-f2bec789-b44b-4c06-b908-212a57ee6b7c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:31.895438 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-f2bec789-b44b-4c06-b908-212a57ee6b7c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:31.905506 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f2bec789-b44b-4c06-b908-212a57ee6b7c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:31.906173 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f2bec789-b44b-4c06-b908-212a57ee6b7c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:31.907188 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f2bec789-b44b-4c06-b908-212a57ee6b7c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:31.914115 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f2bec789-b44b-4c06-b908-212a57ee6b7c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:32.026342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-2a59a94d-890b-4fd6-ab5e-7e71504c5d68 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:32.035320 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-2a59a94d-890b-4fd6-ab5e-7e71504c5d68 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1547 microversion: 2.1 time: 0.394011 Jul 12 17:45:32.035924 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 440/868] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:31 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1547 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:45:32.064591 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-111b76cd-8ea1-4280-af91-6506313c6725 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:32.069533 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-111b76cd-8ea1-4280-af91-6506313c6725 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:32.080317 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-f2bec789-b44b-4c06-b908-212a57ee6b7c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:32.086321 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-111b76cd-8ea1-4280-af91-6506313c6725 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:32.087145 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-111b76cd-8ea1-4280-af91-6506313c6725 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:32.088184 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-111b76cd-8ea1-4280-af91-6506313c6725 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:32.088832 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-111b76cd-8ea1-4280-af91-6506313c6725 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:32.096069 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-f2bec789-b44b-4c06-b908-212a57ee6b7c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:32.098052 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-f2bec789-b44b-4c06-b908-212a57ee6b7c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:32.103881 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-f2bec789-b44b-4c06-b908-212a57ee6b7c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1738 microversion: 2.20 time: 0.214711 Jul 12 17:45:32.114528 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 429/869] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:31 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:45:32.546532 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-111b76cd-8ea1-4280-af91-6506313c6725 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.482498 Jul 12 17:45:32.546532 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 441/870] 10.222.0.16 () {58 vars in 1274 bytes} [Tue Jul 12 17:45:32 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8/os-interface => generated 284 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:45:32.745927 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-90550fbe-b871-4e6f-b818-e6828b62c5d7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:32.746739 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-90550fbe-b871-4e6f-b818-e6828b62c5d7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: ca00771c-f3e8-47de-aafc-9eb8a1a785b1] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:32.758170 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-90550fbe-b871-4e6f-b818-e6828b62c5d7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:32.759510 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-90550fbe-b871-4e6f-b818-e6828b62c5d7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:32.760400 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-90550fbe-b871-4e6f-b818-e6828b62c5d7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:32.760848 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-90550fbe-b871-4e6f-b818-e6828b62c5d7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:33.034289 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-90550fbe-b871-4e6f-b818-e6828b62c5d7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:33.045205 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-90550fbe-b871-4e6f-b818-e6828b62c5d7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1" status: 200 len: 1266 microversion: 2.1 time: 0.303884 Jul 12 17:45:33.046850 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 430/871] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:32 2022] GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1 => generated 1266 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:33.123145 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-525f7319-9d4d-434c-b626-d6a293df6e32 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:33.123745 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-525f7319-9d4d-434c-b626-d6a293df6e32 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:33.138762 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-525f7319-9d4d-434c-b626-d6a293df6e32 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:33.139229 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-525f7319-9d4d-434c-b626-d6a293df6e32 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:33.140026 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-525f7319-9d4d-434c-b626-d6a293df6e32 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:33.140471 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-525f7319-9d4d-434c-b626-d6a293df6e32 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:33.461551 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-525f7319-9d4d-434c-b626-d6a293df6e32 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:33.470970 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-525f7319-9d4d-434c-b626-d6a293df6e32 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:33.472751 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-525f7319-9d4d-434c-b626-d6a293df6e32 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:33.473927 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-525f7319-9d4d-434c-b626-d6a293df6e32 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1738 microversion: 2.20 time: 0.356140 Jul 12 17:45:33.475099 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 442/872] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:33 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1738 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:45:34.062120 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-c711d8ed-f2bd-4089-9811-a067ede88557 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:34.063743 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-c711d8ed-f2bd-4089-9811-a067ede88557 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: ca00771c-f3e8-47de-aafc-9eb8a1a785b1] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:34.067542 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:45:34.079640 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c711d8ed-f2bd-4089-9811-a067ede88557 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:34.079640 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c711d8ed-f2bd-4089-9811-a067ede88557 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:34.079640 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c711d8ed-f2bd-4089-9811-a067ede88557 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:34.079640 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c711d8ed-f2bd-4089-9811-a067ede88557 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:34.246471 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-2c8482dd-3d98-438d-9f68-ebf5f4d276b7 req-27964d59-1aa7-4602-8e3c-b203f09cca6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8f7b428-9b6d-459f-8ad2-cab4f82052e8", "tag": "4aa2bfdc-7ea3-4238-b47f-3803e818647e"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:45:34.247252 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-c711d8ed-f2bd-4089-9811-a067ede88557 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:34.255702 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-2c8482dd-3d98-438d-9f68-ebf5f4d276b7 req-27964d59-1aa7-4602-8e3c-b203f09cca6e service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:34.256151 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-2c8482dd-3d98-438d-9f68-ebf5f4d276b7 req-27964d59-1aa7-4602-8e3c-b203f09cca6e service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:34.257772 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-c711d8ed-f2bd-4089-9811-a067ede88557 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1" status: 200 len: 1266 microversion: 2.1 time: 0.199146 Jul 12 17:45:34.269270 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 431/873] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:34 2022] GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1 => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:45:34.272047 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-2c8482dd-3d98-438d-9f68-ebf5f4d276b7 req-27964d59-1aa7-4602-8e3c-b203f09cca6e service nova] Creating event network-changed:4aa2bfdc-7ea3-4238-b47f-3803e818647e for instance c8f7b428-9b6d-459f-8ad2-cab4f82052e8 on hv-cinder-84875 Jul 12 17:45:34.277333 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-2c8482dd-3d98-438d-9f68-ebf5f4d276b7 req-27964d59-1aa7-4602-8e3c-b203f09cca6e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034944 Jul 12 17:45:34.281296 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 443/874] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:45:34.492681 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-49568ff5-33cf-44a7-bdb0-b39bdef69698 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:34.494105 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-49568ff5-33cf-44a7-bdb0-b39bdef69698 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:34.500290 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-49568ff5-33cf-44a7-bdb0-b39bdef69698 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:34.500754 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-49568ff5-33cf-44a7-bdb0-b39bdef69698 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:34.501524 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-49568ff5-33cf-44a7-bdb0-b39bdef69698 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:34.502139 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-49568ff5-33cf-44a7-bdb0-b39bdef69698 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:34.720024 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-49568ff5-33cf-44a7-bdb0-b39bdef69698 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:34.726719 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-49568ff5-33cf-44a7-bdb0-b39bdef69698 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:34.728380 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-49568ff5-33cf-44a7-bdb0-b39bdef69698 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:34.730806 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-49568ff5-33cf-44a7-bdb0-b39bdef69698 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1738 microversion: 2.20 time: 0.241846 Jul 12 17:45:34.731578 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 432/875] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:34 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1738 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:45:35.278376 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-67473f68-db85-4566-8ecc-c9c97e052bb1 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:35.280602 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-67473f68-db85-4566-8ecc-c9c97e052bb1 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: ca00771c-f3e8-47de-aafc-9eb8a1a785b1] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:35.288009 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-726da037-7316-4779-92ab-8028b4ae7d1b req-258a0409-0e13-416f-89ad-223f129d5e80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca00771c-f3e8-47de-aafc-9eb8a1a785b1", "name": "network-vif-plugged", "status": "completed", "tag": "78739528-de51-4c99-820c-5e39ced35a39"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:45:35.302171 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-67473f68-db85-4566-8ecc-c9c97e052bb1 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:35.304777 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-726da037-7316-4779-92ab-8028b4ae7d1b req-258a0409-0e13-416f-89ad-223f129d5e80 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:35.305523 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-67473f68-db85-4566-8ecc-c9c97e052bb1 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:35.306689 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-67473f68-db85-4566-8ecc-c9c97e052bb1 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:35.307417 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-67473f68-db85-4566-8ecc-c9c97e052bb1 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:35.308125 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-726da037-7316-4779-92ab-8028b4ae7d1b req-258a0409-0e13-416f-89ad-223f129d5e80 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:35.327260 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-726da037-7316-4779-92ab-8028b4ae7d1b req-258a0409-0e13-416f-89ad-223f129d5e80 service nova] Creating event network-vif-plugged:78739528-de51-4c99-820c-5e39ced35a39 for instance ca00771c-f3e8-47de-aafc-9eb8a1a785b1 on hv-cinder-84875 Jul 12 17:45:35.334246 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-726da037-7316-4779-92ab-8028b4ae7d1b req-258a0409-0e13-416f-89ad-223f129d5e80 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049911 Jul 12 17:45:35.339854 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 433/876] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:45:35.587425 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-67473f68-db85-4566-8ecc-c9c97e052bb1 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:35.603603 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-67473f68-db85-4566-8ecc-c9c97e052bb1 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1" status: 200 len: 1266 microversion: 2.1 time: 0.329134 Jul 12 17:45:35.614043 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 444/877] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:35 2022] GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1 => generated 1266 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:35.751554 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-6762a6a0-4fd8-4625-8433-8b999e50d5c0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:35.752268 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-6762a6a0-4fd8-4625-8433-8b999e50d5c0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:35.760301 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6762a6a0-4fd8-4625-8433-8b999e50d5c0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:35.760752 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6762a6a0-4fd8-4625-8433-8b999e50d5c0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:35.761705 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6762a6a0-4fd8-4625-8433-8b999e50d5c0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:35.762157 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6762a6a0-4fd8-4625-8433-8b999e50d5c0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:35.986027 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-6762a6a0-4fd8-4625-8433-8b999e50d5c0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:35.999995 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-6762a6a0-4fd8-4625-8433-8b999e50d5c0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:36.004689 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-6762a6a0-4fd8-4625-8433-8b999e50d5c0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:36.010404 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-6762a6a0-4fd8-4625-8433-8b999e50d5c0 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1738 microversion: 2.20 time: 0.263083 Jul 12 17:45:36.011224 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 434/878] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:35 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1738 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:45:36.626129 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-65a5f882-86fa-4ff4-afc2-2e5e807b2884 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:36.627519 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-65a5f882-86fa-4ff4-afc2-2e5e807b2884 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: ca00771c-f3e8-47de-aafc-9eb8a1a785b1] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:36.637727 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-65a5f882-86fa-4ff4-afc2-2e5e807b2884 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:36.640987 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-65a5f882-86fa-4ff4-afc2-2e5e807b2884 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:36.642107 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-65a5f882-86fa-4ff4-afc2-2e5e807b2884 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:36.642809 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-65a5f882-86fa-4ff4-afc2-2e5e807b2884 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:36.838315 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-65a5f882-86fa-4ff4-afc2-2e5e807b2884 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:36.847706 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-65a5f882-86fa-4ff4-afc2-2e5e807b2884 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1" status: 200 len: 1266 microversion: 2.1 time: 0.229530 Jul 12 17:45:36.848604 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 445/879] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:36 2022] GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:37.030207 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-022cf886-0a8c-4dc1-8db7-82e7fbc41580 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:37.031965 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-022cf886-0a8c-4dc1-8db7-82e7fbc41580 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:37.039201 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-022cf886-0a8c-4dc1-8db7-82e7fbc41580 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:37.039824 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-022cf886-0a8c-4dc1-8db7-82e7fbc41580 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:37.040966 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-022cf886-0a8c-4dc1-8db7-82e7fbc41580 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:37.041439 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-022cf886-0a8c-4dc1-8db7-82e7fbc41580 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:37.185668 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-022cf886-0a8c-4dc1-8db7-82e7fbc41580 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:37.189450 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=100 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:45:37.198901 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-022cf886-0a8c-4dc1-8db7-82e7fbc41580 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:37.202813 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-022cf886-0a8c-4dc1-8db7-82e7fbc41580 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:37.204201 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-022cf886-0a8c-4dc1-8db7-82e7fbc41580 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1738 microversion: 2.20 time: 0.177873 Jul 12 17:45:37.204767 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 435/880] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:37 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:45:37.866127 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a3276f1d-a018-4a4a-ad35-4bd29bda5297 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:37.867875 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-a3276f1d-a018-4a4a-ad35-4bd29bda5297 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: ca00771c-f3e8-47de-aafc-9eb8a1a785b1] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:37.875332 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a3276f1d-a018-4a4a-ad35-4bd29bda5297 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:37.875793 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a3276f1d-a018-4a4a-ad35-4bd29bda5297 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:37.876585 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a3276f1d-a018-4a4a-ad35-4bd29bda5297 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:37.877032 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a3276f1d-a018-4a4a-ad35-4bd29bda5297 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:38.034232 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a3276f1d-a018-4a4a-ad35-4bd29bda5297 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:38.039905 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-a3276f1d-a018-4a4a-ad35-4bd29bda5297 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1" status: 200 len: 1266 microversion: 2.1 time: 0.178508 Jul 12 17:45:38.040616 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 446/881] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:37 2022] GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:38.222854 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-35a7d77b-3e8d-4326-9b4d-a84609d26f98 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:38.223491 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-35a7d77b-3e8d-4326-9b4d-a84609d26f98 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:38.232719 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-35a7d77b-3e8d-4326-9b4d-a84609d26f98 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:38.233273 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-35a7d77b-3e8d-4326-9b4d-a84609d26f98 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:38.234111 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-35a7d77b-3e8d-4326-9b4d-a84609d26f98 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:38.234612 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-35a7d77b-3e8d-4326-9b4d-a84609d26f98 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:38.400125 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-35a7d77b-3e8d-4326-9b4d-a84609d26f98 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:38.415531 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-35a7d77b-3e8d-4326-9b4d-a84609d26f98 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:38.418569 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-35a7d77b-3e8d-4326-9b4d-a84609d26f98 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:38.420506 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-35a7d77b-3e8d-4326-9b4d-a84609d26f98 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1738 microversion: 2.20 time: 0.201756 Jul 12 17:45:38.421247 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 436/882] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:38 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1738 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:45:39.059708 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-15c84613-b50d-46d0-b241-d0f34e2ae444 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:39.062108 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-15c84613-b50d-46d0-b241-d0f34e2ae444 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: ca00771c-f3e8-47de-aafc-9eb8a1a785b1] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:39.073964 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-15c84613-b50d-46d0-b241-d0f34e2ae444 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:39.074924 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-15c84613-b50d-46d0-b241-d0f34e2ae444 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:39.076395 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-15c84613-b50d-46d0-b241-d0f34e2ae444 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:39.078521 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-15c84613-b50d-46d0-b241-d0f34e2ae444 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:39.314980 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-15c84613-b50d-46d0-b241-d0f34e2ae444 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:39.328191 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-15c84613-b50d-46d0-b241-d0f34e2ae444 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1" status: 200 len: 1454 microversion: 2.1 time: 0.274294 Jul 12 17:45:39.329499 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 447/883] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:39 2022] GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1 => generated 1454 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:39.392738 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-d3cae4c2-7eac-4062-84df-ae9bb1b57d46 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:39.395144 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-d3cae4c2-7eac-4062-84df-ae9bb1b57d46 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: ca00771c-f3e8-47de-aafc-9eb8a1a785b1] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:39.409266 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d3cae4c2-7eac-4062-84df-ae9bb1b57d46 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:39.410225 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d3cae4c2-7eac-4062-84df-ae9bb1b57d46 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:39.411779 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d3cae4c2-7eac-4062-84df-ae9bb1b57d46 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:39.412675 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d3cae4c2-7eac-4062-84df-ae9bb1b57d46 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:39.453707 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-bb40ae3a-aed1-4566-8668-6e78f94fa42a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:39.455228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-bb40ae3a-aed1-4566-8668-6e78f94fa42a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:39.474944 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bb40ae3a-aed1-4566-8668-6e78f94fa42a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:39.475678 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bb40ae3a-aed1-4566-8668-6e78f94fa42a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:39.476910 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bb40ae3a-aed1-4566-8668-6e78f94fa42a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:39.478202 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bb40ae3a-aed1-4566-8668-6e78f94fa42a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:39.611329 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-d3cae4c2-7eac-4062-84df-ae9bb1b57d46 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:39.622000 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-d3cae4c2-7eac-4062-84df-ae9bb1b57d46 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1" status: 200 len: 1454 microversion: 2.1 time: 0.237234 Jul 12 17:45:39.622974 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 437/884] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:39 2022] GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1 => generated 1454 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:39.736847 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-bb40ae3a-aed1-4566-8668-6e78f94fa42a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:39.745874 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-bb40ae3a-aed1-4566-8668-6e78f94fa42a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:39.747957 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-bb40ae3a-aed1-4566-8668-6e78f94fa42a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:39.748827 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-bb40ae3a-aed1-4566-8668-6e78f94fa42a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1738 microversion: 2.20 time: 0.303340 Jul 12 17:45:39.749978 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 448/885] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:39 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1738 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:45:40.773485 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b7844f64-411f-4b23-b6ed-35f381fea910 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:40.776098 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-b7844f64-411f-4b23-b6ed-35f381fea910 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:40.789152 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b7844f64-411f-4b23-b6ed-35f381fea910 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:40.791898 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b7844f64-411f-4b23-b6ed-35f381fea910 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:40.793169 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b7844f64-411f-4b23-b6ed-35f381fea910 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:40.794077 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b7844f64-411f-4b23-b6ed-35f381fea910 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:41.066247 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-b7844f64-411f-4b23-b6ed-35f381fea910 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:41.083749 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-b7844f64-411f-4b23-b6ed-35f381fea910 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:41.085928 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-b7844f64-411f-4b23-b6ed-35f381fea910 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:41.088466 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-b7844f64-411f-4b23-b6ed-35f381fea910 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1738 microversion: 2.20 time: 0.322441 Jul 12 17:45:41.103966 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 438/886] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:40 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1738 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:45:42.116783 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-7d2b9ad6-566b-44eb-8fec-e7210ae768fb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:42.117401 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-7d2b9ad6-566b-44eb-8fec-e7210ae768fb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:42.124366 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7d2b9ad6-566b-44eb-8fec-e7210ae768fb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:42.124819 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7d2b9ad6-566b-44eb-8fec-e7210ae768fb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:42.125601 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7d2b9ad6-566b-44eb-8fec-e7210ae768fb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:42.126088 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7d2b9ad6-566b-44eb-8fec-e7210ae768fb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:42.216345 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-56213116-ba17-4964-a53b-7c6ff93d976a req-fff65ada-2905-4d7f-8cfe-c8ad114d88f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca00771c-f3e8-47de-aafc-9eb8a1a785b1", "tag": "78739528-de51-4c99-820c-5e39ced35a39"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:45:42.228002 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-56213116-ba17-4964-a53b-7c6ff93d976a req-fff65ada-2905-4d7f-8cfe-c8ad114d88f9 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:42.228559 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-56213116-ba17-4964-a53b-7c6ff93d976a req-fff65ada-2905-4d7f-8cfe-c8ad114d88f9 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:42.242695 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-56213116-ba17-4964-a53b-7c6ff93d976a req-fff65ada-2905-4d7f-8cfe-c8ad114d88f9 service nova] Creating event network-changed:78739528-de51-4c99-820c-5e39ced35a39 for instance ca00771c-f3e8-47de-aafc-9eb8a1a785b1 on hv-cinder-84875 Jul 12 17:45:42.250626 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-56213116-ba17-4964-a53b-7c6ff93d976a req-fff65ada-2905-4d7f-8cfe-c8ad114d88f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038377 Jul 12 17:45:42.255281 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 439/887] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:45:42.286590 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-7d2b9ad6-566b-44eb-8fec-e7210ae768fb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:42.297480 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-7d2b9ad6-566b-44eb-8fec-e7210ae768fb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:42.299485 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-7d2b9ad6-566b-44eb-8fec-e7210ae768fb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:42.300968 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-7d2b9ad6-566b-44eb-8fec-e7210ae768fb tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1738 microversion: 2.20 time: 0.188469 Jul 12 17:45:42.312575 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 449/888] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:42 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:45:43.322356 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-a42a9851-3dd5-41da-b17d-5431ba1a5f6e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:43.323096 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-a42a9851-3dd5-41da-b17d-5431ba1a5f6e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:43.330896 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a42a9851-3dd5-41da-b17d-5431ba1a5f6e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:43.331427 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a42a9851-3dd5-41da-b17d-5431ba1a5f6e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:43.332448 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a42a9851-3dd5-41da-b17d-5431ba1a5f6e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:43.332992 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a42a9851-3dd5-41da-b17d-5431ba1a5f6e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:43.475477 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-a42a9851-3dd5-41da-b17d-5431ba1a5f6e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:43.484042 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-a42a9851-3dd5-41da-b17d-5431ba1a5f6e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:43.485617 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-a42a9851-3dd5-41da-b17d-5431ba1a5f6e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:43.486964 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-a42a9851-3dd5-41da-b17d-5431ba1a5f6e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1738 microversion: 2.20 time: 0.170059 Jul 12 17:45:43.487415 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 440/889] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:43 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:45:44.504867 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-82c60b1c-a12a-4f9b-bf98-e21121ab8487 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:44.505473 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-82c60b1c-a12a-4f9b-bf98-e21121ab8487 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:44.512453 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-82c60b1c-a12a-4f9b-bf98-e21121ab8487 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:44.512896 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-82c60b1c-a12a-4f9b-bf98-e21121ab8487 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:44.513664 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-82c60b1c-a12a-4f9b-bf98-e21121ab8487 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:44.514094 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-82c60b1c-a12a-4f9b-bf98-e21121ab8487 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:44.654644 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-82c60b1c-a12a-4f9b-bf98-e21121ab8487 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:44.663853 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-82c60b1c-a12a-4f9b-bf98-e21121ab8487 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:44.666151 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-82c60b1c-a12a-4f9b-bf98-e21121ab8487 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:44.667499 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-82c60b1c-a12a-4f9b-bf98-e21121ab8487 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1720 microversion: 2.20 time: 0.166323 Jul 12 17:45:44.668075 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 450/890] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:44 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:45:45.579720 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-6c16f0ef-6446-4175-8830-b6a5c3a21fc7 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:45.580296 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-6c16f0ef-6446-4175-8830-b6a5c3a21fc7 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: c0090e22-9f29-42b1-880a-3c7f2ef84895] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:45.587313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6c16f0ef-6446-4175-8830-b6a5c3a21fc7 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:45.587774 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6c16f0ef-6446-4175-8830-b6a5c3a21fc7 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:45.588610 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6c16f0ef-6446-4175-8830-b6a5c3a21fc7 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:45.589046 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6c16f0ef-6446-4175-8830-b6a5c3a21fc7 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:45.619703 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-6c16f0ef-6446-4175-8830-b6a5c3a21fc7 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895/ips" status: 200 len: 149 microversion: 2.1 time: 0.043987 Jul 12 17:45:45.620317 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 441/891] 10.222.0.16 () {58 vars in 1247 bytes} [Tue Jul 12 17:45:45 2022] GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:45:45.688465 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-b00e384a-c0ff-48e9-a11f-1a92ee0da848 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:45.689139 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-b00e384a-c0ff-48e9-a11f-1a92ee0da848 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:45.697278 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b00e384a-c0ff-48e9-a11f-1a92ee0da848 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:45.697575 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b00e384a-c0ff-48e9-a11f-1a92ee0da848 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:45.698452 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b00e384a-c0ff-48e9-a11f-1a92ee0da848 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:45.699046 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b00e384a-c0ff-48e9-a11f-1a92ee0da848 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:45.725927 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=100 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:45:45.870612 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-b00e384a-c0ff-48e9-a11f-1a92ee0da848 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:45.886725 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-b00e384a-c0ff-48e9-a11f-1a92ee0da848 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:45.888376 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-b00e384a-c0ff-48e9-a11f-1a92ee0da848 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:45.889596 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-b00e384a-c0ff-48e9-a11f-1a92ee0da848 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1720 microversion: 2.20 time: 0.207746 Jul 12 17:45:45.890162 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 451/892] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:45 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1720 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:45:46.908736 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-c7a36251-6a85-40ea-98f1-6fed523c524f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:46.909394 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-c7a36251-6a85-40ea-98f1-6fed523c524f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:46.916159 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c7a36251-6a85-40ea-98f1-6fed523c524f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:46.916608 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c7a36251-6a85-40ea-98f1-6fed523c524f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:46.917385 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c7a36251-6a85-40ea-98f1-6fed523c524f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:46.917805 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c7a36251-6a85-40ea-98f1-6fed523c524f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:47.265399 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-017b53e4-5e44-43ec-8a9b-347693c0e942 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a16fb528-d25d-480f-a177-4629d24181cc"}} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:45:47.266636 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-017b53e4-5e44-43ec-8a9b-347693c0e942 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: c0090e22-9f29-42b1-880a-3c7f2ef84895] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:47.274125 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-017b53e4-5e44-43ec-8a9b-347693c0e942 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:47.274639 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-017b53e4-5e44-43ec-8a9b-347693c0e942 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:47.275512 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-017b53e4-5e44-43ec-8a9b-347693c0e942 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:47.275956 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-017b53e4-5e44-43ec-8a9b-347693c0e942 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:47.316977 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-c7a36251-6a85-40ea-98f1-6fed523c524f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:47.325995 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-c7a36251-6a85-40ea-98f1-6fed523c524f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:47.327622 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-c7a36251-6a85-40ea-98f1-6fed523c524f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:47.328999 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-c7a36251-6a85-40ea-98f1-6fed523c524f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1723 microversion: 2.20 time: 0.424132 Jul 12 17:45:47.329779 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 442/893] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:46 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1723 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:45:47.349333 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-d2f3106a-94c7-4396-a2f7-6bc33beec67f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6ca7c69-f35d-4903-aa6f-2696a640bf8b"}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:45:47.350451 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-d2f3106a-94c7-4396-a2f7-6bc33beec67f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:47.357444 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d2f3106a-94c7-4396-a2f7-6bc33beec67f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:47.357902 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d2f3106a-94c7-4396-a2f7-6bc33beec67f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:47.358749 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d2f3106a-94c7-4396-a2f7-6bc33beec67f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:47.359188 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d2f3106a-94c7-4396-a2f7-6bc33beec67f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:48.041977 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-017b53e4-5e44-43ec-8a9b-347693c0e942 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "POST /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.781466 Jul 12 17:45:48.042861 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 452/894] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jul 12 17:45:47 2022] POST /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895/os-volume_attachments => generated 194 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:45:48.425155 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-d2f3106a-94c7-4396-a2f7-6bc33beec67f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "POST /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.079976 Jul 12 17:45:48.425705 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 443/895] 10.222.0.16 () {62 vars in 1363 bytes} [Tue Jul 12 17:45:47 2022] POST /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe/os-volume_attachments => generated 188 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 17:45:48.541748 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-1f6ecd4e-c350-4b21-9e1e-4eaa692a98a5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:48.542370 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-1f6ecd4e-c350-4b21-9e1e-4eaa692a98a5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:48.550089 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1f6ecd4e-c350-4b21-9e1e-4eaa692a98a5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:48.550569 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1f6ecd4e-c350-4b21-9e1e-4eaa692a98a5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:48.551429 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1f6ecd4e-c350-4b21-9e1e-4eaa692a98a5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:48.551865 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1f6ecd4e-c350-4b21-9e1e-4eaa692a98a5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:48.973751 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-42c9937a-4392-44ae-9870-6db139ec8f13 req-5edb5a4d-60f0-431a-b389-6d672533da30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ad3f97-288d-4704-ad33-35bc58e94dfe", "name": "network-vif-unplugged", "status": "completed", "tag": "c8a33017-1571-46b3-8afd-ee6981b1ac07"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:45:48.982839 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-42c9937a-4392-44ae-9870-6db139ec8f13 req-5edb5a4d-60f0-431a-b389-6d672533da30 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:48.983398 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-42c9937a-4392-44ae-9870-6db139ec8f13 req-5edb5a4d-60f0-431a-b389-6d672533da30 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:48.995241 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.compute.server_external_events [req-42c9937a-4392-44ae-9870-6db139ec8f13 req-5edb5a4d-60f0-431a-b389-6d672533da30 service nova] Unable to find a host for instance 07ad3f97-288d-4704-ad33-35bc58e94dfe. Dropping event network-vif-unplugged {{(pid=130058) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 12 17:45:48.996141 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-42c9937a-4392-44ae-9870-6db139ec8f13 req-5edb5a4d-60f0-431a-b389-6d672533da30 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026532 Jul 12 17:45:48.996742 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 444/896] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 12 17:45:49.202146 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-1f6ecd4e-c350-4b21-9e1e-4eaa692a98a5 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "DELETE /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe/os-volume_attachments/f6ca7c69-f35d-4903-aa6f-2696a640bf8b" status: 202 len: 0 microversion: 2.20 time: 0.664787 Jul 12 17:45:49.202919 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 453/897] 10.222.0.16 () {60 vars in 1456 bytes} [Tue Jul 12 17:45:48 2022] DELETE /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe/os-volume_attachments/f6ca7c69-f35d-4903-aa6f-2696a640bf8b => generated 0 bytes in 667 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:45:49.260691 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-3a88543f-9a9f-4f04-9397-5778ffca39c9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:45:49.261259 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-3a88543f-9a9f-4f04-9397-5778ffca39c9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:49.267289 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3a88543f-9a9f-4f04-9397-5778ffca39c9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:49.273063 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3a88543f-9a9f-4f04-9397-5778ffca39c9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:49.273063 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3a88543f-9a9f-4f04-9397-5778ffca39c9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:49.273063 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3a88543f-9a9f-4f04-9397-5778ffca39c9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:49.646571 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-3a88543f-9a9f-4f04-9397-5778ffca39c9 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "POST /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe/action" status: 202 len: 0 microversion: 2.20 time: 0.390580 Jul 12 17:45:49.647395 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 445/898] 10.222.0.16 () {62 vars in 1318 bytes} [Tue Jul 12 17:45:49 2022] POST /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:45:49.656688 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-af5d5b8d-799b-4f18-af2c-3b2bb57e9e99 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:49.657414 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-af5d5b8d-799b-4f18-af2c-3b2bb57e9e99 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:49.664641 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-af5d5b8d-799b-4f18-af2c-3b2bb57e9e99 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:49.665097 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-af5d5b8d-799b-4f18-af2c-3b2bb57e9e99 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:49.666098 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-af5d5b8d-799b-4f18-af2c-3b2bb57e9e99 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:49.666583 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-af5d5b8d-799b-4f18-af2c-3b2bb57e9e99 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:49.805750 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-af5d5b8d-799b-4f18-af2c-3b2bb57e9e99 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:49.814527 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-af5d5b8d-799b-4f18-af2c-3b2bb57e9e99 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:49.816055 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-af5d5b8d-799b-4f18-af2c-3b2bb57e9e99 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:49.817237 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-af5d5b8d-799b-4f18-af2c-3b2bb57e9e99 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1671 microversion: 2.20 time: 0.164764 Jul 12 17:45:49.817807 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 454/899] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:49 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:45:50.837747 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-acb68760-edb8-487d-87ac-30eb33e855a4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:50.838373 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-acb68760-edb8-487d-87ac-30eb33e855a4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:50.849300 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-acb68760-edb8-487d-87ac-30eb33e855a4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:50.849825 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-acb68760-edb8-487d-87ac-30eb33e855a4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:50.851214 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-acb68760-edb8-487d-87ac-30eb33e855a4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:50.851964 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-acb68760-edb8-487d-87ac-30eb33e855a4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:51.004888 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-acb68760-edb8-487d-87ac-30eb33e855a4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:51.014529 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-acb68760-edb8-487d-87ac-30eb33e855a4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:51.016062 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-acb68760-edb8-487d-87ac-30eb33e855a4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:51.017268 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-acb68760-edb8-487d-87ac-30eb33e855a4 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1671 microversion: 2.20 time: 0.184810 Jul 12 17:45:51.017839 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 446/900] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:50 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1671 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:45:52.035801 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-2a34e8ac-f845-4f6f-811b-5c12611a879b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:52.036418 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-2a34e8ac-f845-4f6f-811b-5c12611a879b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:52.043293 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2a34e8ac-f845-4f6f-811b-5c12611a879b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:52.043747 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2a34e8ac-f845-4f6f-811b-5c12611a879b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:52.044534 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2a34e8ac-f845-4f6f-811b-5c12611a879b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:52.044974 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2a34e8ac-f845-4f6f-811b-5c12611a879b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:52.192556 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-2a34e8ac-f845-4f6f-811b-5c12611a879b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:52.202022 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-2a34e8ac-f845-4f6f-811b-5c12611a879b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:52.203675 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-2a34e8ac-f845-4f6f-811b-5c12611a879b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:52.204958 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-2a34e8ac-f845-4f6f-811b-5c12611a879b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1729 microversion: 2.20 time: 0.173064 Jul 12 17:45:52.205643 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 455/901] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:52 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:45:53.230167 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-ac5b3a5e-1eac-4cd7-9c13-a07c31516dd1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:53.232593 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-ac5b3a5e-1eac-4cd7-9c13-a07c31516dd1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:53.250866 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ac5b3a5e-1eac-4cd7-9c13-a07c31516dd1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:53.254301 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ac5b3a5e-1eac-4cd7-9c13-a07c31516dd1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:53.255910 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ac5b3a5e-1eac-4cd7-9c13-a07c31516dd1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:53.257255 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ac5b3a5e-1eac-4cd7-9c13-a07c31516dd1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:53.490714 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ac5b3a5e-1eac-4cd7-9c13-a07c31516dd1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:53.503062 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ac5b3a5e-1eac-4cd7-9c13-a07c31516dd1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:53.505738 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ac5b3a5e-1eac-4cd7-9c13-a07c31516dd1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:53.507487 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-ac5b3a5e-1eac-4cd7-9c13-a07c31516dd1 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1729 microversion: 2.20 time: 0.286619 Jul 12 17:45:53.520729 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 447/902] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:53 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1729 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:45:54.527297 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-69b710b6-0494-45c6-b667-828c3a720e49 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:54.527915 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-69b710b6-0494-45c6-b667-828c3a720e49 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:54.530419 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_api:SELECT=50 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:45:54.535298 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-69b710b6-0494-45c6-b667-828c3a720e49 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:54.535966 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-69b710b6-0494-45c6-b667-828c3a720e49 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:54.536942 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-69b710b6-0494-45c6-b667-828c3a720e49 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:54.537388 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-69b710b6-0494-45c6-b667-828c3a720e49 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:54.745702 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-69b710b6-0494-45c6-b667-828c3a720e49 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:54.754581 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-69b710b6-0494-45c6-b667-828c3a720e49 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:54.756421 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-69b710b6-0494-45c6-b667-828c3a720e49 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:54.758138 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-69b710b6-0494-45c6-b667-828c3a720e49 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1729 microversion: 2.20 time: 0.234720 Jul 12 17:45:54.759868 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 456/903] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:54 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1729 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:45:55.781899 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-58b22da3-d5f0-4e3a-ad41-9594032e018b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:55.782490 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-58b22da3-d5f0-4e3a-ad41-9594032e018b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:55.789986 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-58b22da3-d5f0-4e3a-ad41-9594032e018b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:55.790449 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-58b22da3-d5f0-4e3a-ad41-9594032e018b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:55.791465 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-58b22da3-d5f0-4e3a-ad41-9594032e018b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:55.791907 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-58b22da3-d5f0-4e3a-ad41-9594032e018b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:55.939497 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-58b22da3-d5f0-4e3a-ad41-9594032e018b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:55.949756 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-58b22da3-d5f0-4e3a-ad41-9594032e018b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:55.952288 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-58b22da3-d5f0-4e3a-ad41-9594032e018b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:55.953858 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-58b22da3-d5f0-4e3a-ad41-9594032e018b tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1729 microversion: 2.20 time: 0.176146 Jul 12 17:45:55.954657 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 448/904] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:55 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:45:56.972158 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-0cda9fa0-b04a-4419-bc0b-b8bc98c0af4e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:56.972874 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-0cda9fa0-b04a-4419-bc0b-b8bc98c0af4e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:56.979859 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0cda9fa0-b04a-4419-bc0b-b8bc98c0af4e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:56.980422 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0cda9fa0-b04a-4419-bc0b-b8bc98c0af4e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:56.981200 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0cda9fa0-b04a-4419-bc0b-b8bc98c0af4e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:56.981625 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0cda9fa0-b04a-4419-bc0b-b8bc98c0af4e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:57.134713 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-0cda9fa0-b04a-4419-bc0b-b8bc98c0af4e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:57.143476 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-0cda9fa0-b04a-4419-bc0b-b8bc98c0af4e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:57.145756 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-0cda9fa0-b04a-4419-bc0b-b8bc98c0af4e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:57.147038 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-0cda9fa0-b04a-4419-bc0b-b8bc98c0af4e tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1729 microversion: 2.20 time: 0.178983 Jul 12 17:45:57.158000 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 457/905] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:56 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:45:58.165517 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-3b2fc000-bb11-4f96-bd82-7c4d822864fd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:58.166272 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-3b2fc000-bb11-4f96-bd82-7c4d822864fd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:58.173182 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3b2fc000-bb11-4f96-bd82-7c4d822864fd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:58.173631 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3b2fc000-bb11-4f96-bd82-7c4d822864fd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:58.174460 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3b2fc000-bb11-4f96-bd82-7c4d822864fd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:58.174903 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3b2fc000-bb11-4f96-bd82-7c4d822864fd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:58.336169 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-3b2fc000-bb11-4f96-bd82-7c4d822864fd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:58.344932 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-3b2fc000-bb11-4f96-bd82-7c4d822864fd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:58.346745 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-3b2fc000-bb11-4f96-bd82-7c4d822864fd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:58.348055 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-3b2fc000-bb11-4f96-bd82-7c4d822864fd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1729 microversion: 2.20 time: 0.186855 Jul 12 17:45:58.348723 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 449/906] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:58 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:45:59.366445 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-c07adb63-0c6c-4295-895c-4d470814fd93 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:59.367103 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-c07adb63-0c6c-4295-895c-4d470814fd93 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:59.374479 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c07adb63-0c6c-4295-895c-4d470814fd93 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:59.375022 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c07adb63-0c6c-4295-895c-4d470814fd93 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:59.375720 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c07adb63-0c6c-4295-895c-4d470814fd93 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:59.376157 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c07adb63-0c6c-4295-895c-4d470814fd93 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:59.539395 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-c07adb63-0c6c-4295-895c-4d470814fd93 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:59.552389 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-c07adb63-0c6c-4295-895c-4d470814fd93 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:59.553928 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-c07adb63-0c6c-4295-895c-4d470814fd93 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:59.555230 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-c07adb63-0c6c-4295-895c-4d470814fd93 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1729 microversion: 2.20 time: 0.192799 Jul 12 17:45:59.555808 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 458/907] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:45:59 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1729 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:46:00.575151 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-45a9a91e-2356-4ca5-b674-efa697ce2027 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:00.575920 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-45a9a91e-2356-4ca5-b674-efa697ce2027 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:00.583969 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-45a9a91e-2356-4ca5-b674-efa697ce2027 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:00.584418 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-45a9a91e-2356-4ca5-b674-efa697ce2027 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:00.585199 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-45a9a91e-2356-4ca5-b674-efa697ce2027 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:00.585628 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-45a9a91e-2356-4ca5-b674-efa697ce2027 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:00.610659 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:46:00.735051 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-45a9a91e-2356-4ca5-b674-efa697ce2027 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:00.744023 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-45a9a91e-2356-4ca5-b674-efa697ce2027 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:00.745623 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-45a9a91e-2356-4ca5-b674-efa697ce2027 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:00.746861 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-45a9a91e-2356-4ca5-b674-efa697ce2027 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1729 microversion: 2.20 time: 0.176634 Jul 12 17:46:00.747689 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 450/908] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:46:00 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:46:01.765923 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-143a49ea-6920-41c3-bac6-9e4753444c3c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:01.766595 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-143a49ea-6920-41c3-bac6-9e4753444c3c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:01.773131 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-143a49ea-6920-41c3-bac6-9e4753444c3c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:01.773586 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-143a49ea-6920-41c3-bac6-9e4753444c3c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:01.774365 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-143a49ea-6920-41c3-bac6-9e4753444c3c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:01.775412 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-143a49ea-6920-41c3-bac6-9e4753444c3c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:01.909159 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-143a49ea-6920-41c3-bac6-9e4753444c3c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:01.917271 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-143a49ea-6920-41c3-bac6-9e4753444c3c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:01.918826 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-143a49ea-6920-41c3-bac6-9e4753444c3c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:01.919999 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-143a49ea-6920-41c3-bac6-9e4753444c3c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1729 microversion: 2.20 time: 0.158128 Jul 12 17:46:01.920565 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 459/909] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:46:01 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:46:02.937535 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-099445ff-15a0-4308-9a04-0166ffa89a41 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:02.938154 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-099445ff-15a0-4308-9a04-0166ffa89a41 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:02.945834 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-099445ff-15a0-4308-9a04-0166ffa89a41 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:02.946289 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-099445ff-15a0-4308-9a04-0166ffa89a41 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:02.947136 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-099445ff-15a0-4308-9a04-0166ffa89a41 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:02.947582 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-099445ff-15a0-4308-9a04-0166ffa89a41 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:03.084033 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-099445ff-15a0-4308-9a04-0166ffa89a41 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:03.092724 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-099445ff-15a0-4308-9a04-0166ffa89a41 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:03.094246 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-099445ff-15a0-4308-9a04-0166ffa89a41 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:03.095443 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-099445ff-15a0-4308-9a04-0166ffa89a41 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1729 microversion: 2.20 time: 0.162004 Jul 12 17:46:03.096009 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 451/910] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:46:02 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:46:04.113662 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-71c6c6ce-fcd2-4867-a7c0-ab85c2091205 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:04.114451 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-71c6c6ce-fcd2-4867-a7c0-ab85c2091205 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:04.121718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-71c6c6ce-fcd2-4867-a7c0-ab85c2091205 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:04.122169 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-71c6c6ce-fcd2-4867-a7c0-ab85c2091205 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:04.122967 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-71c6c6ce-fcd2-4867-a7c0-ab85c2091205 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:04.123402 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-71c6c6ce-fcd2-4867-a7c0-ab85c2091205 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:04.262665 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-71c6c6ce-fcd2-4867-a7c0-ab85c2091205 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:04.272112 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-71c6c6ce-fcd2-4867-a7c0-ab85c2091205 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:04.273674 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-71c6c6ce-fcd2-4867-a7c0-ab85c2091205 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:04.275015 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-71c6c6ce-fcd2-4867-a7c0-ab85c2091205 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1729 microversion: 2.20 time: 0.165057 Jul 12 17:46:04.275629 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 460/911] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:46:04 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:46:05.295822 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-be6b0b79-2816-41d1-97e2-23dd8a60bc2f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:05.296925 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-be6b0b79-2816-41d1-97e2-23dd8a60bc2f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:05.306702 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-be6b0b79-2816-41d1-97e2-23dd8a60bc2f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:05.345774 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-be6b0b79-2816-41d1-97e2-23dd8a60bc2f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:05.345774 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-be6b0b79-2816-41d1-97e2-23dd8a60bc2f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:05.345774 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-be6b0b79-2816-41d1-97e2-23dd8a60bc2f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:05.346594 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-3c22ca27-825e-4a66-9f24-e62e17707ec2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:05.346594 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-3c22ca27-825e-4a66-9f24-e62e17707ec2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: c0090e22-9f29-42b1-880a-3c7f2ef84895] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:05.346594 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3c22ca27-825e-4a66-9f24-e62e17707ec2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:05.346594 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3c22ca27-825e-4a66-9f24-e62e17707ec2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:05.347321 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3c22ca27-825e-4a66-9f24-e62e17707ec2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:05.347321 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3c22ca27-825e-4a66-9f24-e62e17707ec2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:05.475040 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-be6b0b79-2816-41d1-97e2-23dd8a60bc2f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:05.484385 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-be6b0b79-2816-41d1-97e2-23dd8a60bc2f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:05.486076 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-be6b0b79-2816-41d1-97e2-23dd8a60bc2f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:05.487431 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-be6b0b79-2816-41d1-97e2-23dd8a60bc2f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1729 microversion: 2.20 time: 0.196927 Jul 12 17:46:05.488118 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 452/912] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:46:05 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1729 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:46:05.605944 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.objects.instance [None req-3c22ca27-825e-4a66-9f24-e62e17707ec2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lazy-loading 'services' on Instance uuid c0090e22-9f29-42b1-880a-3c7f2ef84895 {{(pid=130059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:46:06.334310 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-3c22ca27-825e-4a66-9f24-e62e17707ec2 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895/os-volume_attachments/a16fb528-d25d-480f-a177-4629d24181cc" status: 202 len: 0 microversion: 2.1 time: 1.000190 Jul 12 17:46:06.334977 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 461/913] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jul 12 17:46:05 2022] DELETE /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895/os-volume_attachments/a16fb528-d25d-480f-a177-4629d24181cc => generated 0 bytes in 1002 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 17:46:06.343515 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-d3a23be8-36a9-40d7-9740-8c9984ba827c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:06.344489 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-d3a23be8-36a9-40d7-9740-8c9984ba827c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: c0090e22-9f29-42b1-880a-3c7f2ef84895] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:06.350529 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d3a23be8-36a9-40d7-9740-8c9984ba827c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:06.351142 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d3a23be8-36a9-40d7-9740-8c9984ba827c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:06.351834 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d3a23be8-36a9-40d7-9740-8c9984ba827c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:06.352267 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d3a23be8-36a9-40d7-9740-8c9984ba827c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:06.381915 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-d3a23be8-36a9-40d7-9740-8c9984ba827c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042442 Jul 12 17:46:06.382385 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 453/914] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:46:06 2022] GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:46:06.506766 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-e42c7d29-30f9-4d4c-964d-1f664bf4b8d6 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:06.507473 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-e42c7d29-30f9-4d4c-964d-1f664bf4b8d6 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:06.513995 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e42c7d29-30f9-4d4c-964d-1f664bf4b8d6 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:06.514574 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e42c7d29-30f9-4d4c-964d-1f664bf4b8d6 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:06.515138 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e42c7d29-30f9-4d4c-964d-1f664bf4b8d6 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:06.515581 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e42c7d29-30f9-4d4c-964d-1f664bf4b8d6 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:06.654962 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-e42c7d29-30f9-4d4c-964d-1f664bf4b8d6 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:06.662946 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-e42c7d29-30f9-4d4c-964d-1f664bf4b8d6 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:06.664451 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-e42c7d29-30f9-4d4c-964d-1f664bf4b8d6 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:06.665604 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-e42c7d29-30f9-4d4c-964d-1f664bf4b8d6 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1729 microversion: 2.20 time: 0.163663 Jul 12 17:46:06.666884 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 462/915] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:46:06 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:46:07.116239 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-b1e03d77-7049-472d-b5ba-085555d3e2c0 req-3bd0f734-e929-4a0c-9476-05a0861e45dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ad3f97-288d-4704-ad33-35bc58e94dfe", "name": "network-vif-plugged", "status": "completed", "tag": "c8a33017-1571-46b3-8afd-ee6981b1ac07"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:46:07.120293 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_api:SELECT=48 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:46:07.125494 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-b1e03d77-7049-472d-b5ba-085555d3e2c0 req-3bd0f734-e929-4a0c-9476-05a0861e45dd service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:07.125933 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-b1e03d77-7049-472d-b5ba-085555d3e2c0 req-3bd0f734-e929-4a0c-9476-05a0861e45dd service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:07.137604 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-b1e03d77-7049-472d-b5ba-085555d3e2c0 req-3bd0f734-e929-4a0c-9476-05a0861e45dd service nova] Creating event network-vif-plugged:c8a33017-1571-46b3-8afd-ee6981b1ac07 for instance 07ad3f97-288d-4704-ad33-35bc58e94dfe on hv-cinder-84875 Jul 12 17:46:07.142761 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-b1e03d77-7049-472d-b5ba-085555d3e2c0 req-3bd0f734-e929-4a0c-9476-05a0861e45dd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030502 Jul 12 17:46:07.143502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 454/916] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:46:07.393817 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-221c7c6a-a2e3-4c4b-ba3c-a39e0d8f5596 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:07.394836 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-221c7c6a-a2e3-4c4b-ba3c-a39e0d8f5596 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: c0090e22-9f29-42b1-880a-3c7f2ef84895] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:07.401360 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-221c7c6a-a2e3-4c4b-ba3c-a39e0d8f5596 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:07.401822 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-221c7c6a-a2e3-4c4b-ba3c-a39e0d8f5596 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:07.402718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-221c7c6a-a2e3-4c4b-ba3c-a39e0d8f5596 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:07.403163 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-221c7c6a-a2e3-4c4b-ba3c-a39e0d8f5596 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:07.429299 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:46:07.435019 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-221c7c6a-a2e3-4c4b-ba3c-a39e0d8f5596 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045230 Jul 12 17:46:07.435592 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 463/917] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:46:07 2022] GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:46:07.685746 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-4276923a-e4c0-4b42-8d80-bf852ae716c2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:07.686459 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-4276923a-e4c0-4b42-8d80-bf852ae716c2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:07.693564 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4276923a-e4c0-4b42-8d80-bf852ae716c2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:07.694266 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4276923a-e4c0-4b42-8d80-bf852ae716c2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:07.695057 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4276923a-e4c0-4b42-8d80-bf852ae716c2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:07.695500 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4276923a-e4c0-4b42-8d80-bf852ae716c2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:07.828220 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-4276923a-e4c0-4b42-8d80-bf852ae716c2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:07.836496 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-4276923a-e4c0-4b42-8d80-bf852ae716c2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:07.838021 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-4276923a-e4c0-4b42-8d80-bf852ae716c2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:07.839220 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-4276923a-e4c0-4b42-8d80-bf852ae716c2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1729 microversion: 2.20 time: 0.158436 Jul 12 17:46:07.839782 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 455/918] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:46:07 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:46:08.447924 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-cd2cbf8c-ebcf-4f6f-8161-f91f02c0e178 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:08.448844 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-cd2cbf8c-ebcf-4f6f-8161-f91f02c0e178 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: c0090e22-9f29-42b1-880a-3c7f2ef84895] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:08.455877 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cd2cbf8c-ebcf-4f6f-8161-f91f02c0e178 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:08.456328 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cd2cbf8c-ebcf-4f6f-8161-f91f02c0e178 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:08.457192 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cd2cbf8c-ebcf-4f6f-8161-f91f02c0e178 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:08.457634 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cd2cbf8c-ebcf-4f6f-8161-f91f02c0e178 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:08.487011 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-cd2cbf8c-ebcf-4f6f-8161-f91f02c0e178 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044312 Jul 12 17:46:08.487578 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 464/919] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:46:08 2022] GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 17:46:08.544915 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-33b2cf28-2f0e-4525-9218-e5db46062b2c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:08.545411 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-33b2cf28-2f0e-4525-9218-e5db46062b2c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: c0090e22-9f29-42b1-880a-3c7f2ef84895] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:08.552331 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-33b2cf28-2f0e-4525-9218-e5db46062b2c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:08.552786 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-33b2cf28-2f0e-4525-9218-e5db46062b2c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:08.553552 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-33b2cf28-2f0e-4525-9218-e5db46062b2c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:08.553990 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-33b2cf28-2f0e-4525-9218-e5db46062b2c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:08.580268 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-33b2cf28-2f0e-4525-9218-e5db46062b2c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: c0090e22-9f29-42b1-880a-3c7f2ef84895] Going to try to terminate instance {{(pid=130058) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:46:08.857079 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-3ca0c1b2-fee2-4013-b719-c4dcbf451af8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:08.857711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-3ca0c1b2-fee2-4013-b719-c4dcbf451af8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:08.864406 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3ca0c1b2-fee2-4013-b719-c4dcbf451af8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:08.870290 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3ca0c1b2-fee2-4013-b719-c4dcbf451af8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:08.870290 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3ca0c1b2-fee2-4013-b719-c4dcbf451af8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:08.870290 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3ca0c1b2-fee2-4013-b719-c4dcbf451af8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:08.894585 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-33b2cf28-2f0e-4525-9218-e5db46062b2c tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895" status: 204 len: 0 microversion: 2.1 time: 0.353423 Jul 12 17:46:08.895315 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 456/920] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 12 17:46:08 2022] DELETE /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:46:08.906464 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-07beda41-68a5-4d29-8bd2-d58703090fe4 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:08.906464 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-07beda41-68a5-4d29-8bd2-d58703090fe4 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: c0090e22-9f29-42b1-880a-3c7f2ef84895] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:08.911506 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-07beda41-68a5-4d29-8bd2-d58703090fe4 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:08.911958 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-07beda41-68a5-4d29-8bd2-d58703090fe4 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:08.912736 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-07beda41-68a5-4d29-8bd2-d58703090fe4 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:08.913795 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-07beda41-68a5-4d29-8bd2-d58703090fe4 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:08.999054 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-3ca0c1b2-fee2-4013-b719-c4dcbf451af8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:09.007131 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-3ca0c1b2-fee2-4013-b719-c4dcbf451af8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:09.008643 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-3ca0c1b2-fee2-4013-b719-c4dcbf451af8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:09.010575 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-3ca0c1b2-fee2-4013-b719-c4dcbf451af8 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1729 microversion: 2.20 time: 0.156982 Jul 12 17:46:09.011033 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 465/921] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:46:08 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:46:09.054997 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-07beda41-68a5-4d29-8bd2-d58703090fe4 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:09.063587 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-07beda41-68a5-4d29-8bd2-d58703090fe4 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895" status: 200 len: 1681 microversion: 2.1 time: 0.163748 Jul 12 17:46:09.064184 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 457/922] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:46:08 2022] GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:46:10.030349 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-92d52297-8e23-4c4d-b43b-77f1b90fd79f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:10.030997 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-92d52297-8e23-4c4d-b43b-77f1b90fd79f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:10.037884 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-92d52297-8e23-4c4d-b43b-77f1b90fd79f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:10.038344 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-92d52297-8e23-4c4d-b43b-77f1b90fd79f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:10.039227 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-92d52297-8e23-4c4d-b43b-77f1b90fd79f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:10.039672 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-92d52297-8e23-4c4d-b43b-77f1b90fd79f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:10.081255 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-fbbb6962-a28c-4b00-9fd7-eee2d2fdf864 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:10.082023 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-fbbb6962-a28c-4b00-9fd7-eee2d2fdf864 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: c0090e22-9f29-42b1-880a-3c7f2ef84895] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:10.089459 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fbbb6962-a28c-4b00-9fd7-eee2d2fdf864 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:10.089907 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fbbb6962-a28c-4b00-9fd7-eee2d2fdf864 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:10.090709 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fbbb6962-a28c-4b00-9fd7-eee2d2fdf864 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:10.091145 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fbbb6962-a28c-4b00-9fd7-eee2d2fdf864 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:10.178566 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-92d52297-8e23-4c4d-b43b-77f1b90fd79f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:10.201001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-92d52297-8e23-4c4d-b43b-77f1b90fd79f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:10.201001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-92d52297-8e23-4c4d-b43b-77f1b90fd79f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:10.201001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-92d52297-8e23-4c4d-b43b-77f1b90fd79f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1729 microversion: 2.20 time: 0.165621 Jul 12 17:46:10.201387 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 466/923] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:46:10 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:46:10.238784 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-fbbb6962-a28c-4b00-9fd7-eee2d2fdf864 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:10.247459 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-fbbb6962-a28c-4b00-9fd7-eee2d2fdf864 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895" status: 200 len: 1681 microversion: 2.1 time: 0.170075 Jul 12 17:46:10.248038 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 458/924] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:46:10 2022] GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:46:10.545062 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-c82df740-9365-4598-b0a1-3100221383a4 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:10.547270 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-c82df740-9365-4598-b0a1-3100221383a4 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:10.551558 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c82df740-9365-4598-b0a1-3100221383a4 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:10.552006 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c82df740-9365-4598-b0a1-3100221383a4 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:10.552794 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c82df740-9365-4598-b0a1-3100221383a4 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:10.553224 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c82df740-9365-4598-b0a1-3100221383a4 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:10.577114 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-c82df740-9365-4598-b0a1-3100221383a4 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8/ips" status: 200 len: 145 microversion: 2.1 time: 0.036484 Jul 12 17:46:10.579002 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 467/925] 10.222.0.16 () {58 vars in 1247 bytes} [Tue Jul 12 17:46:10 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:46:11.209277 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-0ea71ec8-ceef-4be8-a9f6-622c2b87583c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:11.209991 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-0ea71ec8-ceef-4be8-a9f6-622c2b87583c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:11.216863 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ea71ec8-ceef-4be8-a9f6-622c2b87583c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:11.217323 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ea71ec8-ceef-4be8-a9f6-622c2b87583c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:11.218211 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ea71ec8-ceef-4be8-a9f6-622c2b87583c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:11.218686 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ea71ec8-ceef-4be8-a9f6-622c2b87583c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:11.265531 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-54ccbdb6-61ea-431c-9a6e-1e7d06216998 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:11.266251 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-54ccbdb6-61ea-431c-9a6e-1e7d06216998 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: c0090e22-9f29-42b1-880a-3c7f2ef84895] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:11.272851 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-54ccbdb6-61ea-431c-9a6e-1e7d06216998 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:11.273417 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-54ccbdb6-61ea-431c-9a6e-1e7d06216998 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:11.274246 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-54ccbdb6-61ea-431c-9a6e-1e7d06216998 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:11.274780 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-54ccbdb6-61ea-431c-9a6e-1e7d06216998 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:11.413535 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-54ccbdb6-61ea-431c-9a6e-1e7d06216998 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:11.422099 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-54ccbdb6-61ea-431c-9a6e-1e7d06216998 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895" status: 200 len: 1681 microversion: 2.1 time: 0.160476 Jul 12 17:46:11.422717 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 468/926] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:46:11 2022] GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:46:11.446132 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0ea71ec8-ceef-4be8-a9f6-622c2b87583c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:11.454891 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0ea71ec8-ceef-4be8-a9f6-622c2b87583c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:11.456425 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0ea71ec8-ceef-4be8-a9f6-622c2b87583c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:11.457729 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-0ea71ec8-ceef-4be8-a9f6-622c2b87583c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1716 microversion: 2.20 time: 0.252519 Jul 12 17:46:11.458330 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 459/927] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:46:11 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1716 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:46:12.121162 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-e27426df-435c-4b48-82f4-11c8ad00cb62 req-6bfd3a03-549b-4771-99ed-fadc0f77470a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0090e22-9f29-42b1-880a-3c7f2ef84895", "name": "network-vif-deleted", "tag": "578d14a4-10ed-4fd2-88a2-41a179fcacf6"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:46:12.129608 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-e27426df-435c-4b48-82f4-11c8ad00cb62 req-6bfd3a03-549b-4771-99ed-fadc0f77470a service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:12.137331 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-e27426df-435c-4b48-82f4-11c8ad00cb62 req-6bfd3a03-549b-4771-99ed-fadc0f77470a service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:12.141251 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-e27426df-435c-4b48-82f4-11c8ad00cb62 req-6bfd3a03-549b-4771-99ed-fadc0f77470a service nova] Creating event network-vif-deleted:578d14a4-10ed-4fd2-88a2-41a179fcacf6 for instance c0090e22-9f29-42b1-880a-3c7f2ef84895 on hv-cinder-84875 Jul 12 17:46:12.146553 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-e27426df-435c-4b48-82f4-11c8ad00cb62 req-6bfd3a03-549b-4771-99ed-fadc0f77470a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029675 Jul 12 17:46:12.147156 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 469/928] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:46:12.439465 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-c9fb3cee-9840-4d32-9aa7-bf1da763cfe7 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:12.440186 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-c9fb3cee-9840-4d32-9aa7-bf1da763cfe7 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: c0090e22-9f29-42b1-880a-3c7f2ef84895] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:12.447410 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c9fb3cee-9840-4d32-9aa7-bf1da763cfe7 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:12.447917 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c9fb3cee-9840-4d32-9aa7-bf1da763cfe7 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:12.448702 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c9fb3cee-9840-4d32-9aa7-bf1da763cfe7 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:12.449147 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c9fb3cee-9840-4d32-9aa7-bf1da763cfe7 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:12.482298 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c9fb3cee-9840-4d32-9aa7-bf1da763cfe7 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:12.482708 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c9fb3cee-9840-4d32-9aa7-bf1da763cfe7 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:12.483354 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.objects.instance [None req-c9fb3cee-9840-4d32-9aa7-bf1da763cfe7 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lazy-loading 'fault' on Instance uuid c0090e22-9f29-42b1-880a-3c7f2ef84895 {{(pid=130058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:46:12.535482 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-c9fb3cee-9840-4d32-9aa7-bf1da763cfe7 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8441a4a72154ee3bbb95af66abf2ffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84b840eaa59d4f73ac68926437f03d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:12.544008 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-c9fb3cee-9840-4d32-9aa7-bf1da763cfe7 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895" status: 200 len: 1331 microversion: 2.1 time: 0.108506 Jul 12 17:46:12.544753 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 460/929] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:46:12 2022] GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895 => generated 1331 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:46:13.563163 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-b4510bd8-30ab-43d2-b546-b37b6347d3d4 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:13.563908 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-b4510bd8-30ab-43d2-b546-b37b6347d3d4 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: c0090e22-9f29-42b1-880a-3c7f2ef84895] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:13.570601 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b4510bd8-30ab-43d2-b546-b37b6347d3d4 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:13.571051 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b4510bd8-30ab-43d2-b546-b37b6347d3d4 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:13.571886 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b4510bd8-30ab-43d2-b546-b37b6347d3d4 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:13.572399 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b4510bd8-30ab-43d2-b546-b37b6347d3d4 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:13.586390 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-b4510bd8-30ab-43d2-b546-b37b6347d3d4 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] HTTP exception thrown: Instance c0090e22-9f29-42b1-880a-3c7f2ef84895 could not be found. Jul 12 17:46:13.588259 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-b4510bd8-30ab-43d2-b546-b37b6347d3d4 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Request method failure captured: Jul 12 17:46:13.588259 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895 HTTP/1.1 Jul 12 17:46:13.588259 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:46:13.588259 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:46:13.588259 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:46:13.588259 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 0 Jul 12 17:46:13.588259 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:46:13.588259 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:46:13.588259 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:46:13.588259 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:46:13.588259 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbHIKPX81cOSzuTp0O3vMBUQ_2pscgJx1VEp1s8R65yvOz2oUKOjUaqFlJmNQdapSExRqaTx7so1aRxIG_vuYNvJ_o-Kb6m698uGIk6QmB9ep_Ed50ORq5_o-D700OCaKd2Eu3BHwptAzFT8ZMufAhu8lzyW1do401lCvRn-uiuATyM Jul 12 17:46:13.588259 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:46:13.588259 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:46:13.588259 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:46:13.588259 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:46:13.588259 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:46:13.588259 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:46:13.588259 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: 84b840eaa59d4f73ac68926437f03d82 Jul 12 17:46:13.588259 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:46:13.588259 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:46:13.588259 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:46:13.589842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84b840eaa59d4f73ac68926437f03d82", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:46:13.589842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:46:13.589842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: 84b840eaa59d4f73ac68926437f03d82 Jul 12 17:46:13.589842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:46:13.589842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-AttachVolumeNegativeTest-834922830-project Jul 12 17:46:13.589842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:46:13.589842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:46:13.589842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: c8441a4a72154ee3bbb95af66abf2ffd Jul 12 17:46:13.589842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-AttachVolumeNegativeTest-834922830-project Jul 12 17:46:13.589842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: > Jul 12 17:46:13.589842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Instance c0090e22-9f29-42b1-880a-3c7f2ef84895 could not be found. Jul 12 17:46:13.589842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'id': 'c0090e22-9f29-42b1-880a-3c7f2ef84895'} Jul 12 17:46:13.590671 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:46:13.590671 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:13.590671 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:46:13.590671 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:46:13.590671 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:46:13.590671 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:46:13.590671 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:46:13.590671 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:46:13.590671 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:46:13.590671 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:46:13.590671 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0090e22-9f29-42b1-880a-3c7f2ef84895 could not be found. Jul 12 17:46:13.590671 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:46:13.590671 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:46:13.590671 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:46:13.590671 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:13.590671 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:46:13.590671 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:46:13.590671 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:46:13.590671 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:46:13.590671 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:46:13.592255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:46:13.592255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:46:13.592255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:46:13.592255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:46:13.592255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:46:13.592255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:46:13.592255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:46:13.592255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0090e22-9f29-42b1-880a-3c7f2ef84895 could not be found. Jul 12 17:46:13.592255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:46:13.592255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:46:13.592255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:46:13.592255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:13.592255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:46:13.592255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:46:13.592255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:46:13.592255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:46:13.592255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0090e22-9f29-42b1-880a-3c7f2ef84895 could not be found. Jul 12 17:46:13.592255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:46:13.593738 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-b4510bd8-30ab-43d2-b546-b37b6347d3d4 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Returning 404 to user: Instance c0090e22-9f29-42b1-880a-3c7f2ef84895 could not be found. {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:46:13.593738 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-b4510bd8-30ab-43d2-b546-b37b6347d3d4 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895" status: 404 len: 111 microversion: 2.1 time: 0.031455 Jul 12 17:46:13.593738 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 470/930] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:46:13 2022] GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:46:13.599101 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-aece792d-e784-4370-add8-4e2fc5b9b0f8 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '.version_select at 0x7f479fe95820>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:13.696154 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-aece792d-e784-4370-add8-4e2fc5b9b0f8 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1332782440" status: 202 len: 0 microversion: 2.1 time: 0.100882 Jul 12 17:46:13.696745 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 461/931] 10.222.0.16 () {58 vars in 1220 bytes} [Tue Jul 12 17:46:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1332782440 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:46:15.208650 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-9ebda2a2-e0d1-4461-99ca-f767b0626894 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea2b9d2b-eff8-46a5-b1d4-743c251f4c87"}} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:46:15.209792 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-9ebda2a2-e0d1-4461-99ca-f767b0626894 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:15.216633 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9ebda2a2-e0d1-4461-99ca-f767b0626894 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:15.217146 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9ebda2a2-e0d1-4461-99ca-f767b0626894 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:15.218192 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9ebda2a2-e0d1-4461-99ca-f767b0626894 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:15.218668 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9ebda2a2-e0d1-4461-99ca-f767b0626894 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:15.770212 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-88846994-fa75-48af-a083-4708eb8aadba tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:15.770743 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-88846994-fa75-48af-a083-4708eb8aadba tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: c0090e22-9f29-42b1-880a-3c7f2ef84895] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:15.777680 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-88846994-fa75-48af-a083-4708eb8aadba tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:15.778125 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-88846994-fa75-48af-a083-4708eb8aadba tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:15.779142 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-88846994-fa75-48af-a083-4708eb8aadba tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:15.779578 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-88846994-fa75-48af-a083-4708eb8aadba tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:15.792569 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.wsgi [None req-88846994-fa75-48af-a083-4708eb8aadba tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] HTTP exception thrown: Instance c0090e22-9f29-42b1-880a-3c7f2ef84895 could not be found. Jul 12 17:46:15.794996 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-88846994-fa75-48af-a083-4708eb8aadba tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Request method failure captured: Jul 12 17:46:15.794996 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: request: DELETE /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895 HTTP/1.1 Jul 12 17:46:15.794996 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept: application/json Jul 12 17:46:15.794996 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept-Encoding: identity Jul 12 17:46:15.794996 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Connection: close Jul 12 17:46:15.794996 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Length: 0 Jul 12 17:46:15.794996 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Type: application/json Jul 12 17:46:15.794996 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Host: 10.222.0.16 Jul 12 17:46:15.794996 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Openstack-System-Scope: None Jul 12 17:46:15.794996 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: User-Agent: python-urllib3/1.26.9 Jul 12 17:46:15.794996 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Auth-Token: gAAAAABizbHIKPX81cOSzuTp0O3vMBUQ_2pscgJx1VEp1s8R65yvOz2oUKOjUaqFlJmNQdapSExRqaTx7so1aRxIG_vuYNvJ_o-Kb6m698uGIk6QmB9ep_Ed50ORq5_o-D700OCaKd2Eu3BHwptAzFT8ZMufAhu8lzyW1do401lCvRn-uiuATyM Jul 12 17:46:15.794996 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Id: None Jul 12 17:46:15.794996 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Name: None Jul 12 17:46:15.794996 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Identity-Status: Confirmed Jul 12 17:46:15.794996 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Is-Admin-Project: True Jul 12 17:46:15.794996 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Id: default Jul 12 17:46:15.794996 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Name: Default Jul 12 17:46:15.794996 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Id: 84b840eaa59d4f73ac68926437f03d82 Jul 12 17:46:15.794996 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Name: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:46:15.794996 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Role: reader,member Jul 12 17:46:15.794996 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Roles: reader,member Jul 12 17:46:15.796599 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84b840eaa59d4f73ac68926437f03d82", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:46:15.796599 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:46:15.796599 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Id: 84b840eaa59d4f73ac68926437f03d82 Jul 12 17:46:15.796599 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:46:15.796599 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User: tempest-AttachVolumeNegativeTest-834922830-project Jul 12 17:46:15.796599 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Id: default Jul 12 17:46:15.796599 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Name: Default Jul 12 17:46:15.796599 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Id: c8441a4a72154ee3bbb95af66abf2ffd Jul 12 17:46:15.796599 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Name: tempest-AttachVolumeNegativeTest-834922830-project Jul 12 17:46:15.796599 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: method: > Jul 12 17:46:15.796599 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: exception: Instance c0090e22-9f29-42b1-880a-3c7f2ef84895 could not be found. Jul 12 17:46:15.796599 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: action_args: {'id': 'c0090e22-9f29-42b1-880a-3c7f2ef84895'} Jul 12 17:46:15.797509 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:46:15.797509 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:15.797509 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:46:15.797509 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:46:15.797509 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:46:15.797509 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:46:15.797509 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:46:15.797509 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:46:15.797509 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:46:15.797509 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:46:15.797509 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0090e22-9f29-42b1-880a-3c7f2ef84895 could not be found. Jul 12 17:46:15.797509 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:46:15.797509 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:46:15.797509 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:46:15.797509 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:15.797509 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:46:15.797509 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:46:15.797509 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:46:15.797509 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:46:15.797509 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:46:15.801669 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:46:15.801669 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 17:46:15.801669 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 17:46:15.801669 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 17:46:15.801669 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 17:46:15.801669 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:46:15.801669 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:46:15.801669 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:46:15.801669 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:46:15.801669 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0090e22-9f29-42b1-880a-3c7f2ef84895 could not be found. Jul 12 17:46:15.801669 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:46:15.801669 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:46:15.801669 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:46:15.801669 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:15.801669 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:46:15.801669 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:46:15.801669 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:46:15.801669 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:46:15.801669 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0090e22-9f29-42b1-880a-3c7f2ef84895 could not be found. Jul 12 17:46:15.801669 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:46:15.803236 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-88846994-fa75-48af-a083-4708eb8aadba tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Returning 404 to user: Instance c0090e22-9f29-42b1-880a-3c7f2ef84895 could not be found. {{(pid=130058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:46:15.803236 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-88846994-fa75-48af-a083-4708eb8aadba tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895" status: 404 len: 111 microversion: 2.1 time: 0.030754 Jul 12 17:46:15.803236 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 462/932] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 12 17:46:15 2022] DELETE /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 17:46:15.804749 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-162f1878-3bca-49d9-a3cb-881d9a755716 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:15.805347 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-162f1878-3bca-49d9-a3cb-881d9a755716 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: c0090e22-9f29-42b1-880a-3c7f2ef84895] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:15.812015 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-162f1878-3bca-49d9-a3cb-881d9a755716 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:15.812458 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-162f1878-3bca-49d9-a3cb-881d9a755716 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:15.813208 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-162f1878-3bca-49d9-a3cb-881d9a755716 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:15.813641 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-162f1878-3bca-49d9-a3cb-881d9a755716 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:15.827194 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.wsgi [None req-162f1878-3bca-49d9-a3cb-881d9a755716 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] HTTP exception thrown: Instance c0090e22-9f29-42b1-880a-3c7f2ef84895 could not be found. Jul 12 17:46:15.828637 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-162f1878-3bca-49d9-a3cb-881d9a755716 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Request method failure captured: Jul 12 17:46:15.828637 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: request: GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895 HTTP/1.1 Jul 12 17:46:15.828637 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept: application/json Jul 12 17:46:15.828637 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept-Encoding: identity Jul 12 17:46:15.828637 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Connection: close Jul 12 17:46:15.828637 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Length: 0 Jul 12 17:46:15.828637 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Type: application/json Jul 12 17:46:15.828637 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Host: 10.222.0.16 Jul 12 17:46:15.828637 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Openstack-System-Scope: None Jul 12 17:46:15.828637 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: User-Agent: python-urllib3/1.26.9 Jul 12 17:46:15.828637 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Auth-Token: gAAAAABizbHIKPX81cOSzuTp0O3vMBUQ_2pscgJx1VEp1s8R65yvOz2oUKOjUaqFlJmNQdapSExRqaTx7so1aRxIG_vuYNvJ_o-Kb6m698uGIk6QmB9ep_Ed50ORq5_o-D700OCaKd2Eu3BHwptAzFT8ZMufAhu8lzyW1do401lCvRn-uiuATyM Jul 12 17:46:15.828637 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Id: None Jul 12 17:46:15.828637 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Name: None Jul 12 17:46:15.828637 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Identity-Status: Confirmed Jul 12 17:46:15.828637 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Is-Admin-Project: True Jul 12 17:46:15.828637 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Id: default Jul 12 17:46:15.828637 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Name: Default Jul 12 17:46:15.828637 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Id: 84b840eaa59d4f73ac68926437f03d82 Jul 12 17:46:15.828637 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Name: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:46:15.828637 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Role: reader,member Jul 12 17:46:15.828637 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Roles: reader,member Jul 12 17:46:15.830396 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84b840eaa59d4f73ac68926437f03d82", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:46:15.830396 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:46:15.830396 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Id: 84b840eaa59d4f73ac68926437f03d82 Jul 12 17:46:15.830396 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:46:15.830396 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User: tempest-AttachVolumeNegativeTest-834922830-project Jul 12 17:46:15.830396 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Id: default Jul 12 17:46:15.830396 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Name: Default Jul 12 17:46:15.830396 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Id: c8441a4a72154ee3bbb95af66abf2ffd Jul 12 17:46:15.830396 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Name: tempest-AttachVolumeNegativeTest-834922830-project Jul 12 17:46:15.830396 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: method: > Jul 12 17:46:15.830396 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: exception: Instance c0090e22-9f29-42b1-880a-3c7f2ef84895 could not be found. Jul 12 17:46:15.830396 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: action_args: {'id': 'c0090e22-9f29-42b1-880a-3c7f2ef84895'} Jul 12 17:46:15.831569 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:46:15.831569 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:15.831569 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:46:15.831569 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:46:15.831569 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:46:15.831569 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:46:15.831569 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:46:15.831569 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:46:15.831569 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:46:15.831569 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:46:15.831569 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0090e22-9f29-42b1-880a-3c7f2ef84895 could not be found. Jul 12 17:46:15.831569 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:46:15.831569 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:46:15.831569 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:46:15.831569 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:15.831569 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:46:15.831569 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:46:15.831569 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:46:15.831569 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:46:15.831569 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:46:15.833190 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:46:15.833190 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:46:15.833190 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:46:15.833190 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:46:15.833190 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:46:15.833190 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:46:15.833190 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:46:15.833190 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0090e22-9f29-42b1-880a-3c7f2ef84895 could not be found. Jul 12 17:46:15.833190 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:46:15.833190 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:46:15.833190 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:46:15.833190 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:15.833190 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:46:15.833190 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:46:15.833190 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:46:15.833190 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:46:15.833190 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0090e22-9f29-42b1-880a-3c7f2ef84895 could not be found. Jul 12 17:46:15.833190 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:46:15.834712 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-162f1878-3bca-49d9-a3cb-881d9a755716 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Returning 404 to user: Instance c0090e22-9f29-42b1-880a-3c7f2ef84895 could not be found. {{(pid=130058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:46:15.834712 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-162f1878-3bca-49d9-a3cb-881d9a755716 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895" status: 404 len: 111 microversion: 2.1 time: 0.029143 Jul 12 17:46:15.834712 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 463/933] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:46:15 2022] GET /compute/v2.1/servers/c0090e22-9f29-42b1-880a-3c7f2ef84895 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 17:46:15.908759 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-9ebda2a2-e0d1-4461-99ca-f767b0626894 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "POST /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.703920 Jul 12 17:46:15.909410 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 471/934] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jul 12 17:46:15 2022] POST /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8/os-volume_attachments => generated 194 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:46:17.112850 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-8f492c40-71cb-4484-afcc-b77aa65997e0 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:17.113397 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-8f492c40-71cb-4484-afcc-b77aa65997e0 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:17.119692 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8f492c40-71cb-4484-afcc-b77aa65997e0 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:17.125135 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8f492c40-71cb-4484-afcc-b77aa65997e0 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:17.125135 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8f492c40-71cb-4484-afcc-b77aa65997e0 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:17.125135 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8f492c40-71cb-4484-afcc-b77aa65997e0 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:17.135494 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.wsgi [None req-8f492c40-71cb-4484-afcc-b77aa65997e0 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] HTTP exception thrown: Instance 22b53cb5-97e1-40c6-bffe-ca1132409e2f could not be found. Jul 12 17:46:17.137778 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-8f492c40-71cb-4484-afcc-b77aa65997e0 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Request method failure captured: Jul 12 17:46:17.137778 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: request: DELETE /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f HTTP/1.1 Jul 12 17:46:17.137778 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept: application/json Jul 12 17:46:17.137778 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept-Encoding: identity Jul 12 17:46:17.137778 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Connection: close Jul 12 17:46:17.137778 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Length: 0 Jul 12 17:46:17.137778 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Type: application/json Jul 12 17:46:17.137778 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Host: 10.222.0.16 Jul 12 17:46:17.137778 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Openstack-System-Scope: None Jul 12 17:46:17.137778 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: User-Agent: python-urllib3/1.26.9 Jul 12 17:46:17.137778 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Auth-Token: gAAAAABizbHIKPX81cOSzuTp0O3vMBUQ_2pscgJx1VEp1s8R65yvOz2oUKOjUaqFlJmNQdapSExRqaTx7so1aRxIG_vuYNvJ_o-Kb6m698uGIk6QmB9ep_Ed50ORq5_o-D700OCaKd2Eu3BHwptAzFT8ZMufAhu8lzyW1do401lCvRn-uiuATyM Jul 12 17:46:17.137778 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Id: None Jul 12 17:46:17.137778 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Name: None Jul 12 17:46:17.137778 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Identity-Status: Confirmed Jul 12 17:46:17.137778 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Is-Admin-Project: True Jul 12 17:46:17.137778 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Id: default Jul 12 17:46:17.137778 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Name: Default Jul 12 17:46:17.137778 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Id: 84b840eaa59d4f73ac68926437f03d82 Jul 12 17:46:17.137778 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Name: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:46:17.137778 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Role: reader,member Jul 12 17:46:17.137778 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Roles: reader,member Jul 12 17:46:17.140278 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84b840eaa59d4f73ac68926437f03d82", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:46:17.140278 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:46:17.140278 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Id: 84b840eaa59d4f73ac68926437f03d82 Jul 12 17:46:17.140278 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:46:17.140278 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User: tempest-AttachVolumeNegativeTest-834922830-project Jul 12 17:46:17.140278 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Id: default Jul 12 17:46:17.140278 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Name: Default Jul 12 17:46:17.140278 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Id: c8441a4a72154ee3bbb95af66abf2ffd Jul 12 17:46:17.140278 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Name: tempest-AttachVolumeNegativeTest-834922830-project Jul 12 17:46:17.140278 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: method: > Jul 12 17:46:17.140278 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: exception: Instance 22b53cb5-97e1-40c6-bffe-ca1132409e2f could not be found. Jul 12 17:46:17.140278 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: action_args: {'id': '22b53cb5-97e1-40c6-bffe-ca1132409e2f'} Jul 12 17:46:17.141674 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:46:17.141674 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:17.141674 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:46:17.141674 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:46:17.141674 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:46:17.141674 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:46:17.141674 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:46:17.141674 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:46:17.141674 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:46:17.141674 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:46:17.141674 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22b53cb5-97e1-40c6-bffe-ca1132409e2f could not be found. Jul 12 17:46:17.141674 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:46:17.141674 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:46:17.141674 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:46:17.141674 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:17.141674 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:46:17.141674 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:46:17.141674 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:46:17.141674 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:46:17.141674 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:46:17.144480 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:46:17.144480 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 17:46:17.144480 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 17:46:17.144480 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 17:46:17.144480 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 17:46:17.144480 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:46:17.144480 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:46:17.144480 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:46:17.144480 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:46:17.144480 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22b53cb5-97e1-40c6-bffe-ca1132409e2f could not be found. Jul 12 17:46:17.144480 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:46:17.144480 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:46:17.144480 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:46:17.144480 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:17.144480 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:46:17.144480 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:46:17.144480 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:46:17.144480 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:46:17.144480 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22b53cb5-97e1-40c6-bffe-ca1132409e2f could not be found. Jul 12 17:46:17.144480 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:46:17.147215 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-8f492c40-71cb-4484-afcc-b77aa65997e0 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Returning 404 to user: Instance 22b53cb5-97e1-40c6-bffe-ca1132409e2f could not be found. {{(pid=130058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:46:17.147215 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-8f492c40-71cb-4484-afcc-b77aa65997e0 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "DELETE /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f" status: 404 len: 111 microversion: 2.1 time: 0.030343 Jul 12 17:46:17.147215 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 464/935] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 12 17:46:17 2022] DELETE /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:46:17.151159 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-37885846-e649-4f7f-b55d-027e7227ff3b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:17.151871 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-37885846-e649-4f7f-b55d-027e7227ff3b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: 22b53cb5-97e1-40c6-bffe-ca1132409e2f] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:17.158689 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-37885846-e649-4f7f-b55d-027e7227ff3b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:17.159147 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-37885846-e649-4f7f-b55d-027e7227ff3b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:17.160258 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-37885846-e649-4f7f-b55d-027e7227ff3b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:17.160539 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-37885846-e649-4f7f-b55d-027e7227ff3b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:17.174266 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-37885846-e649-4f7f-b55d-027e7227ff3b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] HTTP exception thrown: Instance 22b53cb5-97e1-40c6-bffe-ca1132409e2f could not be found. Jul 12 17:46:17.175961 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-37885846-e649-4f7f-b55d-027e7227ff3b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Request method failure captured: Jul 12 17:46:17.175961 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f HTTP/1.1 Jul 12 17:46:17.175961 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:46:17.175961 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:46:17.175961 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:46:17.175961 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 0 Jul 12 17:46:17.175961 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:46:17.175961 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:46:17.175961 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:46:17.175961 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:46:17.175961 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbHIKPX81cOSzuTp0O3vMBUQ_2pscgJx1VEp1s8R65yvOz2oUKOjUaqFlJmNQdapSExRqaTx7so1aRxIG_vuYNvJ_o-Kb6m698uGIk6QmB9ep_Ed50ORq5_o-D700OCaKd2Eu3BHwptAzFT8ZMufAhu8lzyW1do401lCvRn-uiuATyM Jul 12 17:46:17.175961 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:46:17.175961 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:46:17.175961 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:46:17.175961 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:46:17.175961 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:46:17.175961 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:46:17.175961 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: 84b840eaa59d4f73ac68926437f03d82 Jul 12 17:46:17.175961 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:46:17.175961 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:46:17.175961 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:46:17.177687 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84b840eaa59d4f73ac68926437f03d82", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:46:17.177687 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:46:17.177687 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: 84b840eaa59d4f73ac68926437f03d82 Jul 12 17:46:17.177687 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:46:17.177687 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-AttachVolumeNegativeTest-834922830-project Jul 12 17:46:17.177687 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:46:17.177687 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:46:17.177687 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: c8441a4a72154ee3bbb95af66abf2ffd Jul 12 17:46:17.177687 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-AttachVolumeNegativeTest-834922830-project Jul 12 17:46:17.177687 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: > Jul 12 17:46:17.177687 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Instance 22b53cb5-97e1-40c6-bffe-ca1132409e2f could not be found. Jul 12 17:46:17.177687 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'id': '22b53cb5-97e1-40c6-bffe-ca1132409e2f'} Jul 12 17:46:17.178616 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:46:17.178616 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:17.178616 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:46:17.178616 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:46:17.178616 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:46:17.178616 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:46:17.178616 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:46:17.178616 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:46:17.178616 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:46:17.178616 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:46:17.178616 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22b53cb5-97e1-40c6-bffe-ca1132409e2f could not be found. Jul 12 17:46:17.178616 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:46:17.178616 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:46:17.178616 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:46:17.178616 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:17.178616 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:46:17.178616 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:46:17.178616 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:46:17.178616 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:46:17.178616 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:46:17.179888 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:46:17.179888 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:46:17.179888 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:46:17.179888 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:46:17.179888 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:46:17.179888 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:46:17.179888 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:46:17.179888 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22b53cb5-97e1-40c6-bffe-ca1132409e2f could not be found. Jul 12 17:46:17.179888 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:46:17.179888 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:46:17.179888 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:46:17.179888 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:17.179888 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:46:17.179888 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:46:17.179888 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:46:17.179888 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:46:17.179888 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22b53cb5-97e1-40c6-bffe-ca1132409e2f could not be found. Jul 12 17:46:17.179888 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:46:17.181034 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-37885846-e649-4f7f-b55d-027e7227ff3b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Returning 404 to user: Instance 22b53cb5-97e1-40c6-bffe-ca1132409e2f could not be found. {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:46:17.181034 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-37885846-e649-4f7f-b55d-027e7227ff3b tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f" status: 404 len: 111 microversion: 2.1 time: 0.032701 Jul 12 17:46:17.181034 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 472/936] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:46:17 2022] GET /compute/v2.1/servers/22b53cb5-97e1-40c6-bffe-ca1132409e2f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:46:17.187100 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-0ca9e0b6-07e4-49ad-bea5-144e4dfe5065 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:17.187592 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-0ca9e0b6-07e4-49ad-bea5-144e4dfe5065 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:17.193478 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ca9e0b6-07e4-49ad-bea5-144e4dfe5065 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:17.198022 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ca9e0b6-07e4-49ad-bea5-144e4dfe5065 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:17.198022 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ca9e0b6-07e4-49ad-bea5-144e4dfe5065 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:17.198022 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ca9e0b6-07e4-49ad-bea5-144e4dfe5065 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:17.209653 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.wsgi [None req-0ca9e0b6-07e4-49ad-bea5-144e4dfe5065 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] HTTP exception thrown: Instance dfbdba37-86d8-477a-95a8-9bef8b6df8dd could not be found. Jul 12 17:46:17.211294 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-0ca9e0b6-07e4-49ad-bea5-144e4dfe5065 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Request method failure captured: Jul 12 17:46:17.211294 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: request: DELETE /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd HTTP/1.1 Jul 12 17:46:17.211294 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept: application/json Jul 12 17:46:17.211294 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept-Encoding: identity Jul 12 17:46:17.211294 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Connection: close Jul 12 17:46:17.211294 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Length: 0 Jul 12 17:46:17.211294 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Type: application/json Jul 12 17:46:17.211294 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Host: 10.222.0.16 Jul 12 17:46:17.211294 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Openstack-System-Scope: None Jul 12 17:46:17.211294 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: User-Agent: python-urllib3/1.26.9 Jul 12 17:46:17.211294 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Auth-Token: gAAAAABizbHIKPX81cOSzuTp0O3vMBUQ_2pscgJx1VEp1s8R65yvOz2oUKOjUaqFlJmNQdapSExRqaTx7so1aRxIG_vuYNvJ_o-Kb6m698uGIk6QmB9ep_Ed50ORq5_o-D700OCaKd2Eu3BHwptAzFT8ZMufAhu8lzyW1do401lCvRn-uiuATyM Jul 12 17:46:17.211294 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Id: None Jul 12 17:46:17.211294 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Name: None Jul 12 17:46:17.211294 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Identity-Status: Confirmed Jul 12 17:46:17.211294 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Is-Admin-Project: True Jul 12 17:46:17.211294 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Id: default Jul 12 17:46:17.211294 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Name: Default Jul 12 17:46:17.211294 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Id: 84b840eaa59d4f73ac68926437f03d82 Jul 12 17:46:17.211294 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Name: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:46:17.211294 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Role: reader,member Jul 12 17:46:17.211294 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Roles: reader,member Jul 12 17:46:17.212917 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84b840eaa59d4f73ac68926437f03d82", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:46:17.212917 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:46:17.212917 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Id: 84b840eaa59d4f73ac68926437f03d82 Jul 12 17:46:17.212917 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:46:17.212917 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User: tempest-AttachVolumeNegativeTest-834922830-project Jul 12 17:46:17.212917 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Id: default Jul 12 17:46:17.212917 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Name: Default Jul 12 17:46:17.212917 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Id: c8441a4a72154ee3bbb95af66abf2ffd Jul 12 17:46:17.212917 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Name: tempest-AttachVolumeNegativeTest-834922830-project Jul 12 17:46:17.212917 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: method: > Jul 12 17:46:17.212917 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: exception: Instance dfbdba37-86d8-477a-95a8-9bef8b6df8dd could not be found. Jul 12 17:46:17.212917 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: action_args: {'id': 'dfbdba37-86d8-477a-95a8-9bef8b6df8dd'} Jul 12 17:46:17.213844 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:46:17.213844 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:17.213844 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:46:17.213844 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:46:17.213844 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:46:17.213844 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:46:17.213844 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:46:17.213844 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:46:17.213844 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:46:17.213844 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:46:17.213844 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfbdba37-86d8-477a-95a8-9bef8b6df8dd could not be found. Jul 12 17:46:17.213844 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:46:17.213844 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:46:17.213844 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:46:17.213844 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:17.213844 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:46:17.213844 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:46:17.213844 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:46:17.213844 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:46:17.213844 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:46:17.215472 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:46:17.215472 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 17:46:17.215472 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 17:46:17.215472 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 17:46:17.215472 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 17:46:17.215472 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:46:17.215472 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:46:17.215472 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:46:17.215472 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:46:17.215472 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfbdba37-86d8-477a-95a8-9bef8b6df8dd could not be found. Jul 12 17:46:17.215472 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:46:17.215472 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:46:17.215472 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:46:17.215472 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:17.215472 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:46:17.215472 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:46:17.215472 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:46:17.215472 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:46:17.215472 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfbdba37-86d8-477a-95a8-9bef8b6df8dd could not be found. Jul 12 17:46:17.215472 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:46:17.217094 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-0ca9e0b6-07e4-49ad-bea5-144e4dfe5065 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Returning 404 to user: Instance dfbdba37-86d8-477a-95a8-9bef8b6df8dd could not be found. {{(pid=130058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:46:17.217094 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-0ca9e0b6-07e4-49ad-bea5-144e4dfe5065 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd" status: 404 len: 111 microversion: 2.1 time: 0.030364 Jul 12 17:46:17.217094 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 465/937] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 12 17:46:17 2022] DELETE /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:46:17.221798 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-310ebfa3-c6ad-40fc-8bcf-9ed84f7587b1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:17.222360 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-310ebfa3-c6ad-40fc-8bcf-9ed84f7587b1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: dfbdba37-86d8-477a-95a8-9bef8b6df8dd] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:17.229012 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-310ebfa3-c6ad-40fc-8bcf-9ed84f7587b1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:17.229472 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-310ebfa3-c6ad-40fc-8bcf-9ed84f7587b1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:17.231922 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-310ebfa3-c6ad-40fc-8bcf-9ed84f7587b1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:17.231922 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-310ebfa3-c6ad-40fc-8bcf-9ed84f7587b1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:17.245101 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-310ebfa3-c6ad-40fc-8bcf-9ed84f7587b1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] HTTP exception thrown: Instance dfbdba37-86d8-477a-95a8-9bef8b6df8dd could not be found. Jul 12 17:46:17.247322 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-310ebfa3-c6ad-40fc-8bcf-9ed84f7587b1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Request method failure captured: Jul 12 17:46:17.247322 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd HTTP/1.1 Jul 12 17:46:17.247322 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:46:17.247322 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:46:17.247322 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:46:17.247322 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 0 Jul 12 17:46:17.247322 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:46:17.247322 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:46:17.247322 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:46:17.247322 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:46:17.247322 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbHIKPX81cOSzuTp0O3vMBUQ_2pscgJx1VEp1s8R65yvOz2oUKOjUaqFlJmNQdapSExRqaTx7so1aRxIG_vuYNvJ_o-Kb6m698uGIk6QmB9ep_Ed50ORq5_o-D700OCaKd2Eu3BHwptAzFT8ZMufAhu8lzyW1do401lCvRn-uiuATyM Jul 12 17:46:17.247322 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:46:17.247322 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:46:17.247322 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:46:17.247322 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:46:17.247322 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:46:17.247322 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:46:17.247322 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: 84b840eaa59d4f73ac68926437f03d82 Jul 12 17:46:17.247322 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:46:17.247322 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:46:17.247322 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:46:17.248945 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84b840eaa59d4f73ac68926437f03d82", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:46:17.248945 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:46:17.248945 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: 84b840eaa59d4f73ac68926437f03d82 Jul 12 17:46:17.248945 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:46:17.248945 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-AttachVolumeNegativeTest-834922830-project Jul 12 17:46:17.248945 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:46:17.248945 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:46:17.248945 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: c8441a4a72154ee3bbb95af66abf2ffd Jul 12 17:46:17.248945 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-AttachVolumeNegativeTest-834922830-project Jul 12 17:46:17.248945 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: > Jul 12 17:46:17.248945 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Instance dfbdba37-86d8-477a-95a8-9bef8b6df8dd could not be found. Jul 12 17:46:17.248945 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'id': 'dfbdba37-86d8-477a-95a8-9bef8b6df8dd'} Jul 12 17:46:17.249840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:46:17.249840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:17.249840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:46:17.249840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:46:17.249840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:46:17.249840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:46:17.249840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:46:17.249840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:46:17.249840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:46:17.249840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:46:17.249840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfbdba37-86d8-477a-95a8-9bef8b6df8dd could not be found. Jul 12 17:46:17.249840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:46:17.249840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:46:17.249840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:46:17.249840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:17.249840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:46:17.249840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:46:17.249840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:46:17.249840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:46:17.249840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:46:17.251181 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:46:17.251181 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:46:17.251181 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:46:17.251181 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:46:17.251181 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:46:17.251181 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:46:17.251181 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:46:17.251181 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfbdba37-86d8-477a-95a8-9bef8b6df8dd could not be found. Jul 12 17:46:17.251181 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:46:17.251181 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:46:17.251181 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:46:17.251181 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:17.251181 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:46:17.251181 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:46:17.251181 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:46:17.251181 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:46:17.251181 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfbdba37-86d8-477a-95a8-9bef8b6df8dd could not be found. Jul 12 17:46:17.251181 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:46:17.252592 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-310ebfa3-c6ad-40fc-8bcf-9ed84f7587b1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Returning 404 to user: Instance dfbdba37-86d8-477a-95a8-9bef8b6df8dd could not be found. {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:46:17.252592 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-310ebfa3-c6ad-40fc-8bcf-9ed84f7587b1 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd" status: 404 len: 111 microversion: 2.1 time: 0.031048 Jul 12 17:46:17.252592 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 473/938] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:46:17 2022] GET /compute/v2.1/servers/dfbdba37-86d8-477a-95a8-9bef8b6df8dd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 17:46:18.536887 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-fd5eb521-8465-4d60-aa06-795fa875c061 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:18.537380 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-fd5eb521-8465-4d60-aa06-795fa875c061 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:18.543994 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fd5eb521-8465-4d60-aa06-795fa875c061 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:18.550558 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fd5eb521-8465-4d60-aa06-795fa875c061 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:18.550558 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fd5eb521-8465-4d60-aa06-795fa875c061 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:18.550558 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fd5eb521-8465-4d60-aa06-795fa875c061 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:18.558987 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.wsgi [None req-fd5eb521-8465-4d60-aa06-795fa875c061 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] HTTP exception thrown: Instance edf55e8a-cbc1-45b6-a138-21d5a07301d9 could not be found. Jul 12 17:46:18.561360 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-fd5eb521-8465-4d60-aa06-795fa875c061 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Request method failure captured: Jul 12 17:46:18.561360 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: request: DELETE /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 HTTP/1.1 Jul 12 17:46:18.561360 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept: application/json Jul 12 17:46:18.561360 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept-Encoding: identity Jul 12 17:46:18.561360 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Connection: close Jul 12 17:46:18.561360 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Length: 0 Jul 12 17:46:18.561360 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Type: application/json Jul 12 17:46:18.561360 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Host: 10.222.0.16 Jul 12 17:46:18.561360 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Openstack-System-Scope: None Jul 12 17:46:18.561360 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: User-Agent: python-urllib3/1.26.9 Jul 12 17:46:18.561360 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Auth-Token: gAAAAABizbHIKPX81cOSzuTp0O3vMBUQ_2pscgJx1VEp1s8R65yvOz2oUKOjUaqFlJmNQdapSExRqaTx7so1aRxIG_vuYNvJ_o-Kb6m698uGIk6QmB9ep_Ed50ORq5_o-D700OCaKd2Eu3BHwptAzFT8ZMufAhu8lzyW1do401lCvRn-uiuATyM Jul 12 17:46:18.561360 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Id: None Jul 12 17:46:18.561360 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Name: None Jul 12 17:46:18.561360 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Identity-Status: Confirmed Jul 12 17:46:18.561360 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Is-Admin-Project: True Jul 12 17:46:18.561360 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Id: default Jul 12 17:46:18.561360 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Name: Default Jul 12 17:46:18.561360 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Id: 84b840eaa59d4f73ac68926437f03d82 Jul 12 17:46:18.561360 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Name: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:46:18.561360 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Role: reader,member Jul 12 17:46:18.561360 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Roles: reader,member Jul 12 17:46:18.562993 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84b840eaa59d4f73ac68926437f03d82", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:46:18.562993 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:46:18.562993 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Id: 84b840eaa59d4f73ac68926437f03d82 Jul 12 17:46:18.562993 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:46:18.562993 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User: tempest-AttachVolumeNegativeTest-834922830-project Jul 12 17:46:18.562993 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Id: default Jul 12 17:46:18.562993 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Name: Default Jul 12 17:46:18.562993 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Id: c8441a4a72154ee3bbb95af66abf2ffd Jul 12 17:46:18.562993 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Name: tempest-AttachVolumeNegativeTest-834922830-project Jul 12 17:46:18.562993 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: method: > Jul 12 17:46:18.562993 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: exception: Instance edf55e8a-cbc1-45b6-a138-21d5a07301d9 could not be found. Jul 12 17:46:18.562993 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: action_args: {'id': 'edf55e8a-cbc1-45b6-a138-21d5a07301d9'} Jul 12 17:46:18.564020 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:46:18.564020 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:18.564020 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:46:18.564020 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:46:18.564020 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:46:18.564020 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:46:18.564020 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:46:18.564020 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:46:18.564020 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:46:18.564020 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:46:18.564020 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edf55e8a-cbc1-45b6-a138-21d5a07301d9 could not be found. Jul 12 17:46:18.564020 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:46:18.564020 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:46:18.564020 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:46:18.564020 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:18.564020 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:46:18.564020 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:46:18.564020 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:46:18.564020 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:46:18.564020 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:46:18.565498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:46:18.565498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 17:46:18.565498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 17:46:18.565498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 17:46:18.565498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 17:46:18.565498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:46:18.565498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:46:18.565498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:46:18.565498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:46:18.565498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edf55e8a-cbc1-45b6-a138-21d5a07301d9 could not be found. Jul 12 17:46:18.565498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:46:18.565498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:46:18.565498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:46:18.565498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:18.565498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:46:18.565498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:46:18.565498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:46:18.565498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:46:18.565498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edf55e8a-cbc1-45b6-a138-21d5a07301d9 could not be found. Jul 12 17:46:18.565498 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:46:18.567041 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-fd5eb521-8465-4d60-aa06-795fa875c061 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Returning 404 to user: Instance edf55e8a-cbc1-45b6-a138-21d5a07301d9 could not be found. {{(pid=130058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:46:18.567041 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-fd5eb521-8465-4d60-aa06-795fa875c061 tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "DELETE /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 404 len: 111 microversion: 2.1 time: 0.029712 Jul 12 17:46:18.567041 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 466/939] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 12 17:46:18 2022] DELETE /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 17:46:18.572704 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ebcc64f6-b0ed-468d-8acb-d064c6f4f9ef tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:18.573450 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-ebcc64f6-b0ed-468d-8acb-d064c6f4f9ef tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] [instance: edf55e8a-cbc1-45b6-a138-21d5a07301d9] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:18.580783 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ebcc64f6-b0ed-468d-8acb-d064c6f4f9ef tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:18.581242 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ebcc64f6-b0ed-468d-8acb-d064c6f4f9ef tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:18.582022 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ebcc64f6-b0ed-468d-8acb-d064c6f4f9ef tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:18.582491 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ebcc64f6-b0ed-468d-8acb-d064c6f4f9ef tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:18.596516 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-ebcc64f6-b0ed-468d-8acb-d064c6f4f9ef tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] HTTP exception thrown: Instance edf55e8a-cbc1-45b6-a138-21d5a07301d9 could not be found. Jul 12 17:46:18.598084 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ebcc64f6-b0ed-468d-8acb-d064c6f4f9ef tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Request method failure captured: Jul 12 17:46:18.598084 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 HTTP/1.1 Jul 12 17:46:18.598084 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:46:18.598084 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:46:18.598084 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:46:18.598084 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 0 Jul 12 17:46:18.598084 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:46:18.598084 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:46:18.598084 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:46:18.598084 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:46:18.598084 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbHIKPX81cOSzuTp0O3vMBUQ_2pscgJx1VEp1s8R65yvOz2oUKOjUaqFlJmNQdapSExRqaTx7so1aRxIG_vuYNvJ_o-Kb6m698uGIk6QmB9ep_Ed50ORq5_o-D700OCaKd2Eu3BHwptAzFT8ZMufAhu8lzyW1do401lCvRn-uiuATyM Jul 12 17:46:18.598084 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:46:18.598084 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:46:18.598084 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:46:18.598084 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:46:18.598084 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:46:18.598084 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:46:18.598084 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: 84b840eaa59d4f73ac68926437f03d82 Jul 12 17:46:18.598084 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:46:18.598084 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:46:18.598084 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:46:18.599738 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84b840eaa59d4f73ac68926437f03d82", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84b840eaa59d4f73ac68926437f03d82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:46:18.599738 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:46:18.599738 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: 84b840eaa59d4f73ac68926437f03d82 Jul 12 17:46:18.599738 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-834922830 Jul 12 17:46:18.599738 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-AttachVolumeNegativeTest-834922830-project Jul 12 17:46:18.599738 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:46:18.599738 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:46:18.599738 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: c8441a4a72154ee3bbb95af66abf2ffd Jul 12 17:46:18.599738 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-AttachVolumeNegativeTest-834922830-project Jul 12 17:46:18.599738 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: > Jul 12 17:46:18.599738 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Instance edf55e8a-cbc1-45b6-a138-21d5a07301d9 could not be found. Jul 12 17:46:18.599738 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'id': 'edf55e8a-cbc1-45b6-a138-21d5a07301d9'} Jul 12 17:46:18.600573 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:46:18.600573 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:18.600573 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:46:18.600573 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:46:18.600573 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:46:18.600573 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:46:18.600573 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:46:18.600573 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:46:18.600573 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:46:18.600573 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:46:18.600573 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edf55e8a-cbc1-45b6-a138-21d5a07301d9 could not be found. Jul 12 17:46:18.600573 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:46:18.600573 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:46:18.600573 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:46:18.600573 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:18.600573 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:46:18.600573 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:46:18.600573 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:46:18.600573 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:46:18.600573 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:46:18.601747 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:46:18.601747 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:46:18.601747 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:46:18.601747 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:46:18.601747 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:46:18.601747 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:46:18.601747 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:46:18.601747 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edf55e8a-cbc1-45b6-a138-21d5a07301d9 could not be found. Jul 12 17:46:18.601747 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:46:18.601747 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:46:18.601747 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:46:18.601747 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:18.601747 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:46:18.601747 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:46:18.601747 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:46:18.601747 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:46:18.601747 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edf55e8a-cbc1-45b6-a138-21d5a07301d9 could not be found. Jul 12 17:46:18.601747 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:46:18.602906 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ebcc64f6-b0ed-468d-8acb-d064c6f4f9ef tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] Returning 404 to user: Instance edf55e8a-cbc1-45b6-a138-21d5a07301d9 could not be found. {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:46:18.602906 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-ebcc64f6-b0ed-468d-8acb-d064c6f4f9ef tempest-AttachVolumeNegativeTest-834922830 tempest-AttachVolumeNegativeTest-834922830-project] 10.222.0.16 "GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9" status: 404 len: 111 microversion: 2.1 time: 0.030903 Jul 12 17:46:18.602906 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 474/940] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:46:18 2022] GET /compute/v2.1/servers/edf55e8a-cbc1-45b6-a138-21d5a07301d9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:46:24.471010 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-4ac53a1d-78ef-463b-b2e2-51e92946d36a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:46:24.474063 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4ac53a1d-78ef-463b-b2e2-51e92946d36a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:24.474554 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-4ac53a1d-78ef-463b-b2e2-51e92946d36a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:24.540791 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-4ac53a1d-78ef-463b-b2e2-51e92946d36a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Going to try to stop instance {{(pid=130058) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 12 17:46:24.812190 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-4ac53a1d-78ef-463b-b2e2-51e92946d36a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "POST /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8/action" status: 202 len: 0 microversion: 2.1 time: 0.349583 Jul 12 17:46:24.817028 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 467/941] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jul 12 17:46:24 2022] POST /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:46:24.822618 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-24d84af5-ee12-42a9-a8bf-4f9e9cb68977 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:24.824140 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-24d84af5-ee12-42a9-a8bf-4f9e9cb68977 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:24.826933 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_api:SELECT=38 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:46:24.832341 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-24d84af5-ee12-42a9-a8bf-4f9e9cb68977 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:24.832899 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-24d84af5-ee12-42a9-a8bf-4f9e9cb68977 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:24.833782 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-24d84af5-ee12-42a9-a8bf-4f9e9cb68977 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:24.834293 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-24d84af5-ee12-42a9-a8bf-4f9e9cb68977 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:24.971718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-24d84af5-ee12-42a9-a8bf-4f9e9cb68977 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:24.979984 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-24d84af5-ee12-42a9-a8bf-4f9e9cb68977 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1722 microversion: 2.1 time: 0.161477 Jul 12 17:46:24.980548 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 475/942] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:46:24 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:46:25.999291 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b53c54c6-5a6e-4902-a78e-0adcb395c152 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:25.999918 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-b53c54c6-5a6e-4902-a78e-0adcb395c152 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:26.007294 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b53c54c6-5a6e-4902-a78e-0adcb395c152 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:26.007757 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b53c54c6-5a6e-4902-a78e-0adcb395c152 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:26.008537 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b53c54c6-5a6e-4902-a78e-0adcb395c152 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:26.008983 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b53c54c6-5a6e-4902-a78e-0adcb395c152 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:26.144502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-b53c54c6-5a6e-4902-a78e-0adcb395c152 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:26.152510 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-b53c54c6-5a6e-4902-a78e-0adcb395c152 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1722 microversion: 2.1 time: 0.157687 Jul 12 17:46:26.153083 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 468/943] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:46:25 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:46:27.171227 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-2d203fc5-95e2-4a8d-a4bd-5a09c3df843d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:27.171825 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-2d203fc5-95e2-4a8d-a4bd-5a09c3df843d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:27.179013 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2d203fc5-95e2-4a8d-a4bd-5a09c3df843d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:27.179470 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2d203fc5-95e2-4a8d-a4bd-5a09c3df843d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:27.180237 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2d203fc5-95e2-4a8d-a4bd-5a09c3df843d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:27.180680 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2d203fc5-95e2-4a8d-a4bd-5a09c3df843d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:27.312551 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-2d203fc5-95e2-4a8d-a4bd-5a09c3df843d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:27.321603 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-2d203fc5-95e2-4a8d-a4bd-5a09c3df843d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1722 microversion: 2.1 time: 0.154232 Jul 12 17:46:27.322165 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 476/944] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:46:27 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:46:28.339158 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-59a8c6f8-4fe4-4e50-998b-1c96ff23d63c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:28.343483 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-59a8c6f8-4fe4-4e50-998b-1c96ff23d63c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:28.346548 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-59a8c6f8-4fe4-4e50-998b-1c96ff23d63c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:28.347012 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-59a8c6f8-4fe4-4e50-998b-1c96ff23d63c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:28.347791 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-59a8c6f8-4fe4-4e50-998b-1c96ff23d63c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:28.348230 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-59a8c6f8-4fe4-4e50-998b-1c96ff23d63c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:28.352433 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:46:28.480776 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-59a8c6f8-4fe4-4e50-998b-1c96ff23d63c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:28.489476 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-59a8c6f8-4fe4-4e50-998b-1c96ff23d63c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1722 microversion: 2.1 time: 0.154288 Jul 12 17:46:28.490474 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 469/945] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:46:28 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:46:29.507372 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-01f85495-44b7-45cc-a862-25e42d96ed5f tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:29.507979 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-01f85495-44b7-45cc-a862-25e42d96ed5f tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:29.514493 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-01f85495-44b7-45cc-a862-25e42d96ed5f tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:29.514983 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-01f85495-44b7-45cc-a862-25e42d96ed5f tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:29.515745 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-01f85495-44b7-45cc-a862-25e42d96ed5f tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:29.516176 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-01f85495-44b7-45cc-a862-25e42d96ed5f tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:29.654480 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-01f85495-44b7-45cc-a862-25e42d96ed5f tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:29.663529 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-01f85495-44b7-45cc-a862-25e42d96ed5f tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1722 microversion: 2.1 time: 0.160120 Jul 12 17:46:29.664264 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 477/946] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:46:29 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:46:30.680927 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-03cc417d-b5c0-41f1-a00b-609f18504d35 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:30.681453 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-03cc417d-b5c0-41f1-a00b-609f18504d35 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:30.688670 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-03cc417d-b5c0-41f1-a00b-609f18504d35 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:30.689131 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-03cc417d-b5c0-41f1-a00b-609f18504d35 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:30.689900 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-03cc417d-b5c0-41f1-a00b-609f18504d35 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:30.690373 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-03cc417d-b5c0-41f1-a00b-609f18504d35 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:30.818355 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-03cc417d-b5c0-41f1-a00b-609f18504d35 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:30.826586 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-03cc417d-b5c0-41f1-a00b-609f18504d35 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1722 microversion: 2.1 time: 0.150045 Jul 12 17:46:30.827150 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 470/947] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:46:30 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:46:31.844639 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-e2313c2f-25c3-44b5-803b-ad43aa6dad12 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:31.845821 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-e2313c2f-25c3-44b5-803b-ad43aa6dad12 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:31.852461 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e2313c2f-25c3-44b5-803b-ad43aa6dad12 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:31.852940 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e2313c2f-25c3-44b5-803b-ad43aa6dad12 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:31.853701 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e2313c2f-25c3-44b5-803b-ad43aa6dad12 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:31.854136 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e2313c2f-25c3-44b5-803b-ad43aa6dad12 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:31.988996 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-e2313c2f-25c3-44b5-803b-ad43aa6dad12 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:31.997311 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-e2313c2f-25c3-44b5-803b-ad43aa6dad12 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1722 microversion: 2.1 time: 0.156861 Jul 12 17:46:31.997875 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 478/948] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:46:31 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:46:33.015240 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-37cc974e-561d-4ca5-9ba2-57000574bf1a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:33.015927 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-37cc974e-561d-4ca5-9ba2-57000574bf1a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:33.022342 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-37cc974e-561d-4ca5-9ba2-57000574bf1a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:33.022891 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-37cc974e-561d-4ca5-9ba2-57000574bf1a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:33.023656 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-37cc974e-561d-4ca5-9ba2-57000574bf1a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:33.024098 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-37cc974e-561d-4ca5-9ba2-57000574bf1a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:33.156687 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-37cc974e-561d-4ca5-9ba2-57000574bf1a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:33.165225 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-37cc974e-561d-4ca5-9ba2-57000574bf1a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1722 microversion: 2.1 time: 0.153816 Jul 12 17:46:33.165810 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 471/949] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:46:33 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:46:34.182516 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-f56cd938-6004-418b-9f35-de31593f4628 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:34.183130 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-f56cd938-6004-418b-9f35-de31593f4628 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:34.190037 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f56cd938-6004-418b-9f35-de31593f4628 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:34.190687 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f56cd938-6004-418b-9f35-de31593f4628 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:34.191461 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f56cd938-6004-418b-9f35-de31593f4628 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:34.191899 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f56cd938-6004-418b-9f35-de31593f4628 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:34.325449 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-f56cd938-6004-418b-9f35-de31593f4628 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:34.333766 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-f56cd938-6004-418b-9f35-de31593f4628 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1722 microversion: 2.1 time: 0.154981 Jul 12 17:46:34.334338 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 479/950] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:46:34 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:46:35.350505 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-f52fd005-f8d6-4aac-bed4-4de2f5f16b51 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:35.351117 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-f52fd005-f8d6-4aac-bed4-4de2f5f16b51 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:35.357701 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f52fd005-f8d6-4aac-bed4-4de2f5f16b51 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:35.358154 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f52fd005-f8d6-4aac-bed4-4de2f5f16b51 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:35.358939 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f52fd005-f8d6-4aac-bed4-4de2f5f16b51 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:35.359376 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f52fd005-f8d6-4aac-bed4-4de2f5f16b51 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:35.489331 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-f52fd005-f8d6-4aac-bed4-4de2f5f16b51 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:35.497418 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-f52fd005-f8d6-4aac-bed4-4de2f5f16b51 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1722 microversion: 2.1 time: 0.150880 Jul 12 17:46:35.497986 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 472/951] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:46:35 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:46:36.514738 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-3dcc3429-82b1-430c-8c48-cc3b1e8f3244 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:36.515354 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-3dcc3429-82b1-430c-8c48-cc3b1e8f3244 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:36.522350 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3dcc3429-82b1-430c-8c48-cc3b1e8f3244 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:36.523045 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3dcc3429-82b1-430c-8c48-cc3b1e8f3244 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:36.523956 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3dcc3429-82b1-430c-8c48-cc3b1e8f3244 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:36.524589 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3dcc3429-82b1-430c-8c48-cc3b1e8f3244 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:36.659646 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-3dcc3429-82b1-430c-8c48-cc3b1e8f3244 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:36.667770 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-3dcc3429-82b1-430c-8c48-cc3b1e8f3244 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1722 microversion: 2.1 time: 0.157076 Jul 12 17:46:36.668338 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 480/952] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:46:36 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:46:37.684868 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-8f901ce9-fad8-43ea-b79f-69cd18bd1021 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:37.685436 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-8f901ce9-fad8-43ea-b79f-69cd18bd1021 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:37.691561 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8f901ce9-fad8-43ea-b79f-69cd18bd1021 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:37.692067 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8f901ce9-fad8-43ea-b79f-69cd18bd1021 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:37.692818 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8f901ce9-fad8-43ea-b79f-69cd18bd1021 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:37.693254 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8f901ce9-fad8-43ea-b79f-69cd18bd1021 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:37.826991 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-8f901ce9-fad8-43ea-b79f-69cd18bd1021 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:37.835309 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-8f901ce9-fad8-43ea-b79f-69cd18bd1021 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1699 microversion: 2.1 time: 0.154588 Jul 12 17:46:37.835896 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 473/953] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:46:37 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1699 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:46:37.852931 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-dce387eb-9367-4854-9fe3-77aadd51f7a8 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:46:37.859573 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-dce387eb-9367-4854-9fe3-77aadd51f7a8 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:37.860021 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-dce387eb-9367-4854-9fe3-77aadd51f7a8 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:37.921863 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-dce387eb-9367-4854-9fe3-77aadd51f7a8 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Going to try to start instance {{(pid=130059) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 12 17:46:38.011042 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:46:38.108796 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-dce387eb-9367-4854-9fe3-77aadd51f7a8 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "POST /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8/action" status: 202 len: 0 microversion: 2.1 time: 0.260348 Jul 12 17:46:38.109377 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 481/954] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jul 12 17:46:37 2022] POST /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:46:38.117795 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-db3cd003-a3ee-4860-9e72-6b96ee8b8d98 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:38.118626 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-db3cd003-a3ee-4860-9e72-6b96ee8b8d98 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:38.120584 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:46:38.125480 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-db3cd003-a3ee-4860-9e72-6b96ee8b8d98 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:38.125976 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-db3cd003-a3ee-4860-9e72-6b96ee8b8d98 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:38.126927 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-db3cd003-a3ee-4860-9e72-6b96ee8b8d98 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:38.127342 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-db3cd003-a3ee-4860-9e72-6b96ee8b8d98 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:38.257962 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-db3cd003-a3ee-4860-9e72-6b96ee8b8d98 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:38.266365 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-db3cd003-a3ee-4860-9e72-6b96ee8b8d98 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1708 microversion: 2.1 time: 0.152629 Jul 12 17:46:38.266918 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 474/955] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:46:38 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1708 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:46:39.285835 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-f80e186d-bd90-41df-abcc-e57c7d776297 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:39.286572 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-f80e186d-bd90-41df-abcc-e57c7d776297 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:39.293015 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f80e186d-bd90-41df-abcc-e57c7d776297 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:39.297835 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f80e186d-bd90-41df-abcc-e57c7d776297 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:39.297835 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f80e186d-bd90-41df-abcc-e57c7d776297 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:39.297835 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f80e186d-bd90-41df-abcc-e57c7d776297 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:39.427149 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-f80e186d-bd90-41df-abcc-e57c7d776297 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:39.435161 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-f80e186d-bd90-41df-abcc-e57c7d776297 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1708 microversion: 2.1 time: 0.154743 Jul 12 17:46:39.435733 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 482/956] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:46:39 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1708 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:46:40.453569 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-df6077cc-5a54-47d6-a982-4357c3b6ce4d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:40.454168 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-df6077cc-5a54-47d6-a982-4357c3b6ce4d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:40.461693 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-df6077cc-5a54-47d6-a982-4357c3b6ce4d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:40.462143 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-df6077cc-5a54-47d6-a982-4357c3b6ce4d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:40.462935 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-df6077cc-5a54-47d6-a982-4357c3b6ce4d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:40.463371 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-df6077cc-5a54-47d6-a982-4357c3b6ce4d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:40.593867 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-df6077cc-5a54-47d6-a982-4357c3b6ce4d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:40.603182 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-df6077cc-5a54-47d6-a982-4357c3b6ce4d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1712 microversion: 2.1 time: 0.153801 Jul 12 17:46:40.609007 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 475/957] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:46:40 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1712 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:46:51.002774 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-71ce3e84-5102-42d5-9ff4-e99e5a33198a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:51.003803 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-71ce3e84-5102-42d5-9ff4-e99e5a33198a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:51.007138 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_api:SELECT=15 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:46:51.007826 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=6 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:46:51.012700 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-71ce3e84-5102-42d5-9ff4-e99e5a33198a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:51.013206 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-71ce3e84-5102-42d5-9ff4-e99e5a33198a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:51.014074 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-71ce3e84-5102-42d5-9ff4-e99e5a33198a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:51.014553 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-71ce3e84-5102-42d5-9ff4-e99e5a33198a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:51.043323 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-71ce3e84-5102-42d5-9ff4-e99e5a33198a tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044508 Jul 12 17:46:51.043895 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 483/958] 10.222.0.16 () {60 vars in 1342 bytes} [Tue Jul 12 17:46:50 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:46:51.103952 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-a1617dc0-0d3a-4e35-8740-b41c9fbcb39f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:51.104452 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-a1617dc0-0d3a-4e35-8740-b41c9fbcb39f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:51.106929 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_api:SELECT=3 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:46:51.107581 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=40 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:46:51.112289 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a1617dc0-0d3a-4e35-8740-b41c9fbcb39f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:51.112738 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a1617dc0-0d3a-4e35-8740-b41c9fbcb39f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:51.114133 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a1617dc0-0d3a-4e35-8740-b41c9fbcb39f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:51.114784 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a1617dc0-0d3a-4e35-8740-b41c9fbcb39f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:51.140414 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-a1617dc0-0d3a-4e35-8740-b41c9fbcb39f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Going to try to terminate instance {{(pid=130058) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:46:51.448895 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-a1617dc0-0d3a-4e35-8740-b41c9fbcb39f tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "DELETE /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 204 len: 0 microversion: 2.20 time: 0.348438 Jul 12 17:46:51.449481 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 476/959] 10.222.0.16 () {60 vars in 1279 bytes} [Tue Jul 12 17:46:51 2022] DELETE /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 17:46:51.457996 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-66bfe680-c491-4352-89cc-76beb93cc184 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:51.458681 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-66bfe680-c491-4352-89cc-76beb93cc184 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:51.465706 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-66bfe680-c491-4352-89cc-76beb93cc184 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:51.466156 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-66bfe680-c491-4352-89cc-76beb93cc184 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:51.466955 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-66bfe680-c491-4352-89cc-76beb93cc184 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:51.467392 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-66bfe680-c491-4352-89cc-76beb93cc184 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:51.600000 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-66bfe680-c491-4352-89cc-76beb93cc184 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:51.608054 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-66bfe680-c491-4352-89cc-76beb93cc184 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:51.609595 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-66bfe680-c491-4352-89cc-76beb93cc184 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:51.610778 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-66bfe680-c491-4352-89cc-76beb93cc184 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1722 microversion: 2.20 time: 0.156895 Jul 12 17:46:51.611337 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 484/960] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:46:51 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:46:52.631448 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-029afebc-9929-4708-ae05-fa3b6618d538 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:52.632337 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-029afebc-9929-4708-ae05-fa3b6618d538 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:52.639888 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-029afebc-9929-4708-ae05-fa3b6618d538 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:52.640356 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-029afebc-9929-4708-ae05-fa3b6618d538 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:52.641132 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-029afebc-9929-4708-ae05-fa3b6618d538 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:52.641601 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-029afebc-9929-4708-ae05-fa3b6618d538 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:52.780157 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-029afebc-9929-4708-ae05-fa3b6618d538 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:52.789053 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-029afebc-9929-4708-ae05-fa3b6618d538 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:52.790621 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-029afebc-9929-4708-ae05-fa3b6618d538 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:52.791787 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-029afebc-9929-4708-ae05-fa3b6618d538 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1722 microversion: 2.20 time: 0.166042 Jul 12 17:46:52.792344 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 477/961] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:46:52 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:46:53.810376 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-76f32881-f322-407c-870f-6dd63e486864 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:53.811094 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-76f32881-f322-407c-870f-6dd63e486864 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:53.818198 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-76f32881-f322-407c-870f-6dd63e486864 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:53.819042 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-76f32881-f322-407c-870f-6dd63e486864 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:53.819814 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-76f32881-f322-407c-870f-6dd63e486864 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:53.820247 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-76f32881-f322-407c-870f-6dd63e486864 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:53.901736 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-76f32881-f322-407c-870f-6dd63e486864 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:53.923557 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-76f32881-f322-407c-870f-6dd63e486864 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:53.925136 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-76f32881-f322-407c-870f-6dd63e486864 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:53.926951 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-76f32881-f322-407c-870f-6dd63e486864 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1654 microversion: 2.20 time: 0.120433 Jul 12 17:46:53.927559 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 485/962] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:46:53 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1654 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:46:53.938869 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-b1a607f2-5b19-4550-87ea-66c2ffbafaed req-991fbffa-c0c1-4eef-97b7-61ed7d8c27d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ad3f97-288d-4704-ad33-35bc58e94dfe", "name": "network-vif-deleted", "tag": "c8a33017-1571-46b3-8afd-ee6981b1ac07"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:46:53.950465 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-b1a607f2-5b19-4550-87ea-66c2ffbafaed req-991fbffa-c0c1-4eef-97b7-61ed7d8c27d0 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:53.950909 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-b1a607f2-5b19-4550-87ea-66c2ffbafaed req-991fbffa-c0c1-4eef-97b7-61ed7d8c27d0 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:53.962648 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-b1a607f2-5b19-4550-87ea-66c2ffbafaed req-991fbffa-c0c1-4eef-97b7-61ed7d8c27d0 service nova] Creating event network-vif-deleted:c8a33017-1571-46b3-8afd-ee6981b1ac07 for instance 07ad3f97-288d-4704-ad33-35bc58e94dfe on hv-cinder-84875 Jul 12 17:46:53.967545 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-b1a607f2-5b19-4550-87ea-66c2ffbafaed req-991fbffa-c0c1-4eef-97b7-61ed7d8c27d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032364 Jul 12 17:46:53.968136 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 478/963] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:46:54.946246 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ae3631e9-23af-4169-a01a-06468c289bac tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:54.946886 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-ae3631e9-23af-4169-a01a-06468c289bac tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:54.953375 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ae3631e9-23af-4169-a01a-06468c289bac tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:54.953822 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ae3631e9-23af-4169-a01a-06468c289bac tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:54.954659 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ae3631e9-23af-4169-a01a-06468c289bac tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:54.955095 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ae3631e9-23af-4169-a01a-06468c289bac tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:55.271171 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-ae3631e9-23af-4169-a01a-06468c289bac tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:55.279333 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-ae3631e9-23af-4169-a01a-06468c289bac tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:55.280897 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-ae3631e9-23af-4169-a01a-06468c289bac tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:55.282050 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-ae3631e9-23af-4169-a01a-06468c289bac tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1654 microversion: 2.20 time: 0.340893 Jul 12 17:46:55.282641 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 486/964] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:46:54 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1654 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:46:56.302582 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-a8422465-2264-4649-bedd-d15a9e575113 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:56.303285 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-a8422465-2264-4649-bedd-d15a9e575113 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:56.309652 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a8422465-2264-4649-bedd-d15a9e575113 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:56.310111 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a8422465-2264-4649-bedd-d15a9e575113 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:56.313292 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a8422465-2264-4649-bedd-d15a9e575113 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:56.313292 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a8422465-2264-4649-bedd-d15a9e575113 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:56.345110 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a8422465-2264-4649-bedd-d15a9e575113 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:56.345562 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a8422465-2264-4649-bedd-d15a9e575113 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:56.346025 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.objects.instance [None req-a8422465-2264-4649-bedd-d15a9e575113 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lazy-loading 'fault' on Instance uuid 07ad3f97-288d-4704-ad33-35bc58e94dfe {{(pid=130058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:46:56.389472 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-a8422465-2264-4649-bedd-d15a9e575113 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:56.397668 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-a8422465-2264-4649-bedd-d15a9e575113 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:56.399289 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-a8422465-2264-4649-bedd-d15a9e575113 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9feeaf257bb441b7a14b57f1f493d08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49227e443aa94a438bf7954aa0398cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:46:56.400521 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-a8422465-2264-4649-bedd-d15a9e575113 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 200 len: 1370 microversion: 2.20 time: 0.103370 Jul 12 17:46:56.401056 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 479/965] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:46:56 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 1370 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:46:57.419554 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-d91479cf-f269-4e6c-8a77-8b19a3cf4508 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:57.420151 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-d91479cf-f269-4e6c-8a77-8b19a3cf4508 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:57.427519 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d91479cf-f269-4e6c-8a77-8b19a3cf4508 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:57.427974 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d91479cf-f269-4e6c-8a77-8b19a3cf4508 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:57.428789 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d91479cf-f269-4e6c-8a77-8b19a3cf4508 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:57.429235 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d91479cf-f269-4e6c-8a77-8b19a3cf4508 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:57.445674 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-d91479cf-f269-4e6c-8a77-8b19a3cf4508 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] HTTP exception thrown: Instance 07ad3f97-288d-4704-ad33-35bc58e94dfe could not be found. Jul 12 17:46:57.447415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-d91479cf-f269-4e6c-8a77-8b19a3cf4508 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Request method failure captured: Jul 12 17:46:57.447415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe HTTP/1.1 Jul 12 17:46:57.447415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:46:57.447415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:46:57.447415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:46:57.447415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 0 Jul 12 17:46:57.447415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:46:57.447415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:46:57.447415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:46:57.447415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:46:57.447415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbHFQ7sUnYCKjKjCnGOE2JO95ulUmkw4gdbuIOyIGzCWuZAANUJ8MDnNZ3jvnVVQVGbWAywYnJ-rPvCjRNUtHvlJXEMsKebSZeUhjllYWrTIMwqa0z1JZYx9Cb0AEwzGs7un35qDttf7w1T8RKRClaLWuwTxZXXKoDOK0L_0d6QtWtQ Jul 12 17:46:57.447415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:46:57.447415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:46:57.447415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:46:57.447415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:46:57.447415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 17:46:57.447415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:46:57.447415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:46:57.447415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: 49227e443aa94a438bf7954aa0398cb9 Jul 12 17:46:57.447415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-596445083 Jul 12 17:46:57.447415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:46:57.447415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:46:57.449189 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/49227e443aa94a438bf7954aa0398cb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_49227e443aa94a438bf7954aa0398cb9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/49227e443aa94a438bf7954aa0398cb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/49227e443aa94a438bf7954aa0398cb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:46:57.449189 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-AttachVolumeShelveTestJSON-596445083 Jul 12 17:46:57.449189 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: 49227e443aa94a438bf7954aa0398cb9 Jul 12 17:46:57.449189 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-596445083 Jul 12 17:46:57.449189 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-AttachVolumeShelveTestJSON-596445083-project Jul 12 17:46:57.449189 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:46:57.449189 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:46:57.449189 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: 9feeaf257bb441b7a14b57f1f493d08f Jul 12 17:46:57.449189 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-AttachVolumeShelveTestJSON-596445083-project Jul 12 17:46:57.449189 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: > Jul 12 17:46:57.449189 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Instance 07ad3f97-288d-4704-ad33-35bc58e94dfe could not be found. Jul 12 17:46:57.449189 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'id': '07ad3f97-288d-4704-ad33-35bc58e94dfe'} Jul 12 17:46:57.450111 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:46:57.450111 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:57.450111 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:46:57.450111 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:46:57.450111 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:46:57.450111 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:46:57.450111 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:46:57.450111 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:46:57.450111 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:46:57.450111 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:46:57.450111 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07ad3f97-288d-4704-ad33-35bc58e94dfe could not be found. Jul 12 17:46:57.450111 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:46:57.450111 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:46:57.450111 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:46:57.450111 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:57.450111 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:46:57.450111 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:46:57.450111 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:46:57.450111 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:46:57.450111 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:46:57.451557 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:46:57.451557 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:46:57.451557 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:46:57.451557 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:46:57.451557 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:46:57.451557 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:46:57.451557 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:46:57.451557 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07ad3f97-288d-4704-ad33-35bc58e94dfe could not be found. Jul 12 17:46:57.451557 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:46:57.451557 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:46:57.451557 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:46:57.451557 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:57.451557 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:46:57.451557 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:46:57.451557 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:46:57.451557 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:46:57.451557 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07ad3f97-288d-4704-ad33-35bc58e94dfe could not be found. Jul 12 17:46:57.451557 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:46:57.452843 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-d91479cf-f269-4e6c-8a77-8b19a3cf4508 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Returning 404 to user: Instance 07ad3f97-288d-4704-ad33-35bc58e94dfe could not be found. {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:46:57.452843 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-d91479cf-f269-4e6c-8a77-8b19a3cf4508 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 404 len: 111 microversion: 2.20 time: 0.033343 Jul 12 17:46:57.452843 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 487/966] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:46:57 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 17:46:57.457994 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-8627bea4-f3d2-4ef0-a7c0-90983dcf845c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '.version_select at 0x7f479fc79b80>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:57.581303 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-8627bea4-f3d2-4ef0-a7c0-90983dcf845c tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-618324942" status: 204 len: 0 microversion: 2.20 time: 0.127132 Jul 12 17:46:57.585825 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 480/967] 10.222.0.16 () {60 vars in 1258 bytes} [Tue Jul 12 17:46:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-618324942 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 12 17:46:59.595552 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-d6699891-21ac-4c06-bbe4-a08a85bd7d5d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:59.596086 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-d6699891-21ac-4c06-bbe4-a08a85bd7d5d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:59.603200 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d6699891-21ac-4c06-bbe4-a08a85bd7d5d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:59.603659 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d6699891-21ac-4c06-bbe4-a08a85bd7d5d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:59.605797 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d6699891-21ac-4c06-bbe4-a08a85bd7d5d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:59.605797 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d6699891-21ac-4c06-bbe4-a08a85bd7d5d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:59.619429 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-d6699891-21ac-4c06-bbe4-a08a85bd7d5d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] HTTP exception thrown: Instance 07ad3f97-288d-4704-ad33-35bc58e94dfe could not be found. Jul 12 17:46:59.621001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-d6699891-21ac-4c06-bbe4-a08a85bd7d5d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Request method failure captured: Jul 12 17:46:59.621001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: DELETE /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe HTTP/1.1 Jul 12 17:46:59.621001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:46:59.621001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:46:59.621001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:46:59.621001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 0 Jul 12 17:46:59.621001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:46:59.621001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:46:59.621001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:46:59.621001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:46:59.621001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbHFQ7sUnYCKjKjCnGOE2JO95ulUmkw4gdbuIOyIGzCWuZAANUJ8MDnNZ3jvnVVQVGbWAywYnJ-rPvCjRNUtHvlJXEMsKebSZeUhjllYWrTIMwqa0z1JZYx9Cb0AEwzGs7un35qDttf7w1T8RKRClaLWuwTxZXXKoDOK0L_0d6QtWtQ Jul 12 17:46:59.621001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:46:59.621001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:46:59.621001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:46:59.621001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:46:59.621001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 17:46:59.621001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:46:59.621001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:46:59.621001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: 49227e443aa94a438bf7954aa0398cb9 Jul 12 17:46:59.621001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-596445083 Jul 12 17:46:59.621001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:46:59.621001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:46:59.622718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/49227e443aa94a438bf7954aa0398cb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_49227e443aa94a438bf7954aa0398cb9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/49227e443aa94a438bf7954aa0398cb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/49227e443aa94a438bf7954aa0398cb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:46:59.622718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-AttachVolumeShelveTestJSON-596445083 Jul 12 17:46:59.622718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: 49227e443aa94a438bf7954aa0398cb9 Jul 12 17:46:59.622718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-596445083 Jul 12 17:46:59.622718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-AttachVolumeShelveTestJSON-596445083-project Jul 12 17:46:59.622718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:46:59.622718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:46:59.622718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: 9feeaf257bb441b7a14b57f1f493d08f Jul 12 17:46:59.622718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-AttachVolumeShelveTestJSON-596445083-project Jul 12 17:46:59.622718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: > Jul 12 17:46:59.622718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Instance 07ad3f97-288d-4704-ad33-35bc58e94dfe could not be found. Jul 12 17:46:59.622718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'id': '07ad3f97-288d-4704-ad33-35bc58e94dfe'} Jul 12 17:46:59.626766 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:46:59.626766 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:59.626766 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:46:59.626766 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:46:59.626766 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:46:59.626766 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:46:59.626766 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:46:59.626766 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:46:59.626766 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:46:59.626766 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:46:59.626766 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07ad3f97-288d-4704-ad33-35bc58e94dfe could not be found. Jul 12 17:46:59.626766 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:46:59.626766 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:46:59.626766 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:46:59.626766 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:59.626766 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:46:59.626766 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:46:59.626766 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:46:59.626766 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:46:59.626766 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:46:59.628290 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:46:59.628290 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 17:46:59.628290 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 17:46:59.628290 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 17:46:59.628290 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 17:46:59.628290 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:46:59.628290 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:46:59.628290 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:46:59.628290 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:46:59.628290 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07ad3f97-288d-4704-ad33-35bc58e94dfe could not be found. Jul 12 17:46:59.628290 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:46:59.628290 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:46:59.628290 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:46:59.628290 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:59.628290 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:46:59.628290 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:46:59.628290 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:46:59.628290 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:46:59.628290 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07ad3f97-288d-4704-ad33-35bc58e94dfe could not be found. Jul 12 17:46:59.628290 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:46:59.629971 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-d6699891-21ac-4c06-bbe4-a08a85bd7d5d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Returning 404 to user: Instance 07ad3f97-288d-4704-ad33-35bc58e94dfe could not be found. {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:46:59.629971 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-d6699891-21ac-4c06-bbe4-a08a85bd7d5d tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "DELETE /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 404 len: 111 microversion: 2.20 time: 0.030961 Jul 12 17:46:59.629971 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 488/968] 10.222.0.16 () {60 vars in 1279 bytes} [Tue Jul 12 17:46:59 2022] DELETE /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 17:46:59.633205 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-e2b01f01-e8f5-4b45-85b7-3b27383fa5d7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:46:59.633822 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-e2b01f01-e8f5-4b45-85b7-3b27383fa5d7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 07ad3f97-288d-4704-ad33-35bc58e94dfe] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:46:59.641448 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e2b01f01-e8f5-4b45-85b7-3b27383fa5d7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:59.641913 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e2b01f01-e8f5-4b45-85b7-3b27383fa5d7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:59.642724 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e2b01f01-e8f5-4b45-85b7-3b27383fa5d7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:46:59.643167 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e2b01f01-e8f5-4b45-85b7-3b27383fa5d7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:46:59.656291 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.wsgi [None req-e2b01f01-e8f5-4b45-85b7-3b27383fa5d7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] HTTP exception thrown: Instance 07ad3f97-288d-4704-ad33-35bc58e94dfe could not be found. Jul 12 17:46:59.657953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-e2b01f01-e8f5-4b45-85b7-3b27383fa5d7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Request method failure captured: Jul 12 17:46:59.657953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: request: GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe HTTP/1.1 Jul 12 17:46:59.657953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept: application/json Jul 12 17:46:59.657953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept-Encoding: identity Jul 12 17:46:59.657953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Connection: close Jul 12 17:46:59.657953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Length: 0 Jul 12 17:46:59.657953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Type: application/json Jul 12 17:46:59.657953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Host: 10.222.0.16 Jul 12 17:46:59.657953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Openstack-System-Scope: None Jul 12 17:46:59.657953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: User-Agent: python-urllib3/1.26.9 Jul 12 17:46:59.657953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Auth-Token: gAAAAABizbHFQ7sUnYCKjKjCnGOE2JO95ulUmkw4gdbuIOyIGzCWuZAANUJ8MDnNZ3jvnVVQVGbWAywYnJ-rPvCjRNUtHvlJXEMsKebSZeUhjllYWrTIMwqa0z1JZYx9Cb0AEwzGs7un35qDttf7w1T8RKRClaLWuwTxZXXKoDOK0L_0d6QtWtQ Jul 12 17:46:59.657953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Id: None Jul 12 17:46:59.657953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Name: None Jul 12 17:46:59.657953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Identity-Status: Confirmed Jul 12 17:46:59.657953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Is-Admin-Project: True Jul 12 17:46:59.657953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 17:46:59.657953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Id: default Jul 12 17:46:59.657953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Name: Default Jul 12 17:46:59.657953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Id: 49227e443aa94a438bf7954aa0398cb9 Jul 12 17:46:59.657953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-596445083 Jul 12 17:46:59.657953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Role: reader,member Jul 12 17:46:59.657953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Roles: reader,member Jul 12 17:46:59.659623 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/49227e443aa94a438bf7954aa0398cb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_49227e443aa94a438bf7954aa0398cb9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/49227e443aa94a438bf7954aa0398cb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/49227e443aa94a438bf7954aa0398cb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:46:59.659623 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant: tempest-AttachVolumeShelveTestJSON-596445083 Jul 12 17:46:59.659623 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Id: 49227e443aa94a438bf7954aa0398cb9 Jul 12 17:46:59.659623 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-596445083 Jul 12 17:46:59.659623 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User: tempest-AttachVolumeShelveTestJSON-596445083-project Jul 12 17:46:59.659623 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Id: default Jul 12 17:46:59.659623 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Name: Default Jul 12 17:46:59.659623 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Id: 9feeaf257bb441b7a14b57f1f493d08f Jul 12 17:46:59.659623 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Name: tempest-AttachVolumeShelveTestJSON-596445083-project Jul 12 17:46:59.659623 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: method: > Jul 12 17:46:59.659623 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: exception: Instance 07ad3f97-288d-4704-ad33-35bc58e94dfe could not be found. Jul 12 17:46:59.659623 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: action_args: {'id': '07ad3f97-288d-4704-ad33-35bc58e94dfe'} Jul 12 17:46:59.661161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:46:59.661161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:59.661161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:46:59.661161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:46:59.661161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:46:59.661161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:46:59.661161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:46:59.661161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:46:59.661161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:46:59.661161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:46:59.661161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07ad3f97-288d-4704-ad33-35bc58e94dfe could not be found. Jul 12 17:46:59.661161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:46:59.661161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:46:59.661161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:46:59.661161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:59.661161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:46:59.661161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:46:59.661161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:46:59.661161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:46:59.661161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:46:59.662505 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:46:59.662505 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:46:59.662505 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:46:59.662505 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:46:59.662505 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:46:59.662505 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:46:59.662505 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:46:59.662505 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07ad3f97-288d-4704-ad33-35bc58e94dfe could not be found. Jul 12 17:46:59.662505 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:46:59.662505 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:46:59.662505 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:46:59.662505 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:46:59.662505 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:46:59.662505 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:46:59.662505 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:46:59.662505 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:46:59.662505 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07ad3f97-288d-4704-ad33-35bc58e94dfe could not be found. Jul 12 17:46:59.662505 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:46:59.663717 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-e2b01f01-e8f5-4b45-85b7-3b27383fa5d7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Returning 404 to user: Instance 07ad3f97-288d-4704-ad33-35bc58e94dfe could not be found. {{(pid=130058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:46:59.663717 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-e2b01f01-e8f5-4b45-85b7-3b27383fa5d7 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe" status: 404 len: 111 microversion: 2.20 time: 0.030411 Jul 12 17:46:59.663717 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 481/969] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:46:59 2022] GET /compute/v2.1/servers/07ad3f97-288d-4704-ad33-35bc58e94dfe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 17:47:03.026073 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-2d91e996-9873-4ee4-8e5f-71702ce2b9e2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:03.026634 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-2d91e996-9873-4ee4-8e5f-71702ce2b9e2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:03.033111 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2d91e996-9873-4ee4-8e5f-71702ce2b9e2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:03.033566 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2d91e996-9873-4ee4-8e5f-71702ce2b9e2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:03.034336 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2d91e996-9873-4ee4-8e5f-71702ce2b9e2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:03.034832 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2d91e996-9873-4ee4-8e5f-71702ce2b9e2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:03.049082 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-2d91e996-9873-4ee4-8e5f-71702ce2b9e2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] HTTP exception thrown: Instance 7f88418d-5f96-4c05-adf4-09d83f045699 could not be found. Jul 12 17:47:03.050700 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-2d91e996-9873-4ee4-8e5f-71702ce2b9e2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Request method failure captured: Jul 12 17:47:03.050700 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: DELETE /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 HTTP/1.1 Jul 12 17:47:03.050700 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:47:03.050700 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:47:03.050700 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:47:03.050700 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 0 Jul 12 17:47:03.050700 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:47:03.050700 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:47:03.050700 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:47:03.050700 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:47:03.050700 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbHFQ7sUnYCKjKjCnGOE2JO95ulUmkw4gdbuIOyIGzCWuZAANUJ8MDnNZ3jvnVVQVGbWAywYnJ-rPvCjRNUtHvlJXEMsKebSZeUhjllYWrTIMwqa0z1JZYx9Cb0AEwzGs7un35qDttf7w1T8RKRClaLWuwTxZXXKoDOK0L_0d6QtWtQ Jul 12 17:47:03.050700 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:47:03.050700 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:47:03.050700 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:47:03.050700 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:47:03.050700 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 17:47:03.050700 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:47:03.050700 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:47:03.050700 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: 49227e443aa94a438bf7954aa0398cb9 Jul 12 17:47:03.050700 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-596445083 Jul 12 17:47:03.050700 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:47:03.050700 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:47:03.052317 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/49227e443aa94a438bf7954aa0398cb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_49227e443aa94a438bf7954aa0398cb9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/49227e443aa94a438bf7954aa0398cb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/49227e443aa94a438bf7954aa0398cb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:47:03.052317 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-AttachVolumeShelveTestJSON-596445083 Jul 12 17:47:03.052317 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: 49227e443aa94a438bf7954aa0398cb9 Jul 12 17:47:03.052317 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-596445083 Jul 12 17:47:03.052317 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-AttachVolumeShelveTestJSON-596445083-project Jul 12 17:47:03.052317 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:47:03.052317 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:47:03.052317 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: 9feeaf257bb441b7a14b57f1f493d08f Jul 12 17:47:03.052317 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-AttachVolumeShelveTestJSON-596445083-project Jul 12 17:47:03.052317 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: > Jul 12 17:47:03.052317 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Instance 7f88418d-5f96-4c05-adf4-09d83f045699 could not be found. Jul 12 17:47:03.052317 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'id': '7f88418d-5f96-4c05-adf4-09d83f045699'} Jul 12 17:47:03.053110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:47:03.053110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:03.053110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:47:03.053110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:47:03.053110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:47:03.053110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:47:03.053110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:47:03.053110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:47:03.053110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:47:03.053110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:47:03.053110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f88418d-5f96-4c05-adf4-09d83f045699 could not be found. Jul 12 17:47:03.053110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:03.053110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:47:03.053110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:03.053110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:03.053110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:47:03.053110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:47:03.053110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:47:03.053110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:47:03.053110 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:47:03.054313 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:47:03.054313 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 17:47:03.054313 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 17:47:03.054313 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 17:47:03.054313 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 17:47:03.054313 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:47:03.054313 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:47:03.054313 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:47:03.054313 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:47:03.054313 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f88418d-5f96-4c05-adf4-09d83f045699 could not be found. Jul 12 17:47:03.054313 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:03.054313 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:47:03.054313 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:03.054313 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:03.054313 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:47:03.054313 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:47:03.054313 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:47:03.054313 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:47:03.054313 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f88418d-5f96-4c05-adf4-09d83f045699 could not be found. Jul 12 17:47:03.054313 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:03.055570 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-2d91e996-9873-4ee4-8e5f-71702ce2b9e2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Returning 404 to user: Instance 7f88418d-5f96-4c05-adf4-09d83f045699 could not be found. {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:47:03.055570 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-2d91e996-9873-4ee4-8e5f-71702ce2b9e2 tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 404 len: 111 microversion: 2.20 time: 0.029983 Jul 12 17:47:03.055570 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 489/970] 10.222.0.16 () {60 vars in 1279 bytes} [Tue Jul 12 17:47:03 2022] DELETE /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 17:47:03.061613 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-8cedc073-da26-410e-a2b6-6260373834cd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:03.062227 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-8cedc073-da26-410e-a2b6-6260373834cd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] [instance: 7f88418d-5f96-4c05-adf4-09d83f045699] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:03.069378 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8cedc073-da26-410e-a2b6-6260373834cd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:03.069830 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8cedc073-da26-410e-a2b6-6260373834cd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:03.070651 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8cedc073-da26-410e-a2b6-6260373834cd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:03.071096 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8cedc073-da26-410e-a2b6-6260373834cd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:03.085817 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.wsgi [None req-8cedc073-da26-410e-a2b6-6260373834cd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] HTTP exception thrown: Instance 7f88418d-5f96-4c05-adf4-09d83f045699 could not be found. Jul 12 17:47:03.087593 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-8cedc073-da26-410e-a2b6-6260373834cd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Request method failure captured: Jul 12 17:47:03.087593 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: request: GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 HTTP/1.1 Jul 12 17:47:03.087593 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept: application/json Jul 12 17:47:03.087593 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept-Encoding: identity Jul 12 17:47:03.087593 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Connection: close Jul 12 17:47:03.087593 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Length: 0 Jul 12 17:47:03.087593 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Type: application/json Jul 12 17:47:03.087593 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Host: 10.222.0.16 Jul 12 17:47:03.087593 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Openstack-System-Scope: None Jul 12 17:47:03.087593 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: User-Agent: python-urllib3/1.26.9 Jul 12 17:47:03.087593 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Auth-Token: gAAAAABizbHFQ7sUnYCKjKjCnGOE2JO95ulUmkw4gdbuIOyIGzCWuZAANUJ8MDnNZ3jvnVVQVGbWAywYnJ-rPvCjRNUtHvlJXEMsKebSZeUhjllYWrTIMwqa0z1JZYx9Cb0AEwzGs7un35qDttf7w1T8RKRClaLWuwTxZXXKoDOK0L_0d6QtWtQ Jul 12 17:47:03.087593 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Id: None Jul 12 17:47:03.087593 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Name: None Jul 12 17:47:03.087593 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Identity-Status: Confirmed Jul 12 17:47:03.087593 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Is-Admin-Project: True Jul 12 17:47:03.087593 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 17:47:03.087593 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Id: default Jul 12 17:47:03.087593 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Name: Default Jul 12 17:47:03.087593 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Id: 49227e443aa94a438bf7954aa0398cb9 Jul 12 17:47:03.087593 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-596445083 Jul 12 17:47:03.087593 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Role: reader,member Jul 12 17:47:03.087593 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Roles: reader,member Jul 12 17:47:03.089373 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/49227e443aa94a438bf7954aa0398cb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_49227e443aa94a438bf7954aa0398cb9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/49227e443aa94a438bf7954aa0398cb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/49227e443aa94a438bf7954aa0398cb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:47:03.089373 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant: tempest-AttachVolumeShelveTestJSON-596445083 Jul 12 17:47:03.089373 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Id: 49227e443aa94a438bf7954aa0398cb9 Jul 12 17:47:03.089373 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-596445083 Jul 12 17:47:03.089373 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User: tempest-AttachVolumeShelveTestJSON-596445083-project Jul 12 17:47:03.089373 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Id: default Jul 12 17:47:03.089373 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Name: Default Jul 12 17:47:03.089373 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Id: 9feeaf257bb441b7a14b57f1f493d08f Jul 12 17:47:03.089373 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Name: tempest-AttachVolumeShelveTestJSON-596445083-project Jul 12 17:47:03.089373 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: method: > Jul 12 17:47:03.089373 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: exception: Instance 7f88418d-5f96-4c05-adf4-09d83f045699 could not be found. Jul 12 17:47:03.089373 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: action_args: {'id': '7f88418d-5f96-4c05-adf4-09d83f045699'} Jul 12 17:47:03.090225 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:47:03.090225 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:03.090225 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:47:03.090225 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:47:03.090225 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:47:03.090225 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:47:03.090225 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:47:03.090225 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:47:03.090225 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:47:03.090225 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:47:03.090225 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f88418d-5f96-4c05-adf4-09d83f045699 could not be found. Jul 12 17:47:03.090225 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:47:03.090225 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:47:03.090225 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:47:03.090225 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:03.090225 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:47:03.090225 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:47:03.090225 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:47:03.090225 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:47:03.090225 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:47:03.091707 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:47:03.091707 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:47:03.091707 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:47:03.091707 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:47:03.091707 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:47:03.091707 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:47:03.091707 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:47:03.091707 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f88418d-5f96-4c05-adf4-09d83f045699 could not be found. Jul 12 17:47:03.091707 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:47:03.091707 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:47:03.091707 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:47:03.091707 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:03.091707 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:47:03.091707 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:47:03.091707 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:47:03.091707 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:47:03.091707 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f88418d-5f96-4c05-adf4-09d83f045699 could not be found. Jul 12 17:47:03.091707 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:47:03.093005 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-8cedc073-da26-410e-a2b6-6260373834cd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] Returning 404 to user: Instance 7f88418d-5f96-4c05-adf4-09d83f045699 could not be found. {{(pid=130058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:47:03.093005 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-8cedc073-da26-410e-a2b6-6260373834cd tempest-AttachVolumeShelveTestJSON-596445083 tempest-AttachVolumeShelveTestJSON-596445083-project] 10.222.0.16 "GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699" status: 404 len: 111 microversion: 2.20 time: 0.032393 Jul 12 17:47:03.093005 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 482/971] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 12 17:47:03 2022] GET /compute/v2.1/servers/7f88418d-5f96-4c05-adf4-09d83f045699 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 17:47:08.817231 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-2f223685-7d60-4c26-9a71-f3931f56291a tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] Action: 'create', calling method: .version_select at 0x7f479fb86af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-458723732"}} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:47:09.608054 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-2f223685-7d60-4c26-9a71-f3931f56291a tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.948352 Jul 12 17:47:09.608658 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 490/972] 10.222.0.16 () {60 vars in 1154 bytes} [Tue Jul 12 17:47:08 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 950 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 12 17:47:09.620754 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-275128db-373d-4456-bd1d-4129420da331 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] Calling method '.version_select at 0x7f479fe955e0>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:09.673668 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-275128db-373d-4456-bd1d-4129420da331 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/8244047c-318d-4e0b-9dcb-919d9a86f60f" status: 200 len: 344 microversion: 2.1 time: 0.056850 Jul 12 17:47:09.674242 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 483/973] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jul 12 17:47:09 2022] GET /compute/v2.1/os-volumes/8244047c-318d-4e0b-9dcb-919d9a86f60f => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:47:10.687128 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-16fd3941-25e0-4f93-8e4e-b458e8c58a3d tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] Calling method '.version_select at 0x7f479fd92280>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:10.736495 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-16fd3941-25e0-4f93-8e4e-b458e8c58a3d tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/8244047c-318d-4e0b-9dcb-919d9a86f60f" status: 200 len: 345 microversion: 2.1 time: 0.053902 Jul 12 17:47:10.737097 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 491/974] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jul 12 17:47:10 2022] GET /compute/v2.1/os-volumes/8244047c-318d-4e0b-9dcb-919d9a86f60f => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:47:10.757137 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-928292da-b6f9-487b-b612-9748715c94f2 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] Action: 'create', calling method: .version_select at 0x7f479fe5a820>, body: {"snapshot": {"volume_id": "8244047c-318d-4e0b-9dcb-919d9a86f60f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1815787862"}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:47:11.182009 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-928292da-b6f9-487b-b612-9748715c94f2 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.429745 Jul 12 17:47:11.182670 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 484/975] 10.222.0.16 () {60 vars in 1161 bytes} [Tue Jul 12 17:47:10 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:47:11.192677 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-95ca761f-a854-4dd8-b6cb-ae4d7f4554ff tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] Calling method '.version_select at 0x7f479fc14ca0>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:11.223668 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-95ca761f-a854-4dd8-b6cb-ae4d7f4554ff tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/d4840ed5-3ca3-4462-93c3-d9d9f7dbf2d5" status: 200 len: 287 microversion: 2.1 time: 0.034914 Jul 12 17:47:11.224447 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 492/976] 10.222.0.16 () {58 vars in 1250 bytes} [Tue Jul 12 17:47:11 2022] GET /compute/v2.1/os-snapshots/d4840ed5-3ca3-4462-93c3-d9d9f7dbf2d5 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:47:11.234057 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-0f423392-32fb-4442-93b2-6db9dd6861d8 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] Calling method '.version_select at 0x7f47ac05a940>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:11.268929 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-0f423392-32fb-4442-93b2-6db9dd6861d8 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034914 Jul 12 17:47:11.268929 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 485/977] 10.222.0.16 () {58 vars in 1139 bytes} [Tue Jul 12 17:47:11 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:47:11.277996 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-c697d17f-8b0e-4e6a-9a18-edd76f7775e8 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] Calling method '.version_select at 0x7f479fdff550>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:11.308163 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-c697d17f-8b0e-4e6a-9a18-edd76f7775e8 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/d4840ed5-3ca3-4462-93c3-d9d9f7dbf2d5" status: 200 len: 287 microversion: 2.1 time: 0.034110 Jul 12 17:47:11.308899 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 493/978] 10.222.0.16 () {58 vars in 1250 bytes} [Tue Jul 12 17:47:11 2022] GET /compute/v2.1/os-snapshots/d4840ed5-3ca3-4462-93c3-d9d9f7dbf2d5 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:47:12.321756 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-656caf6f-7df5-4451-8a04-065defa111d5 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] Calling method '.version_select at 0x7f479fe95670>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:12.351272 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-656caf6f-7df5-4451-8a04-065defa111d5 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/d4840ed5-3ca3-4462-93c3-d9d9f7dbf2d5" status: 200 len: 287 microversion: 2.1 time: 0.034716 Jul 12 17:47:12.351874 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 486/979] 10.222.0.16 () {58 vars in 1250 bytes} [Tue Jul 12 17:47:12 2022] GET /compute/v2.1/os-snapshots/d4840ed5-3ca3-4462-93c3-d9d9f7dbf2d5 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:47:13.360205 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_api:SELECT=14 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:47:13.360965 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=30 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:47:13.364952 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-93669bef-7f99-4420-b7f7-ab4f901d8d7e tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] Calling method '.version_select at 0x7f479fb86b80>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:13.394022 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-93669bef-7f99-4420-b7f7-ab4f901d8d7e tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/d4840ed5-3ca3-4462-93c3-d9d9f7dbf2d5" status: 200 len: 287 microversion: 2.1 time: 0.035093 Jul 12 17:47:13.394621 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 494/980] 10.222.0.16 () {58 vars in 1250 bytes} [Tue Jul 12 17:47:13 2022] GET /compute/v2.1/os-snapshots/d4840ed5-3ca3-4462-93c3-d9d9f7dbf2d5 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:47:14.403941 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:47:14.404720 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:47:14.409196 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-4926b66b-5962-4c09-a781-a7d416cf7647 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] Calling method '.version_select at 0x7f479fe47550>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:14.441045 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-4926b66b-5962-4c09-a781-a7d416cf7647 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/d4840ed5-3ca3-4462-93c3-d9d9f7dbf2d5" status: 200 len: 287 microversion: 2.1 time: 0.038040 Jul 12 17:47:14.441615 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 487/981] 10.222.0.16 () {58 vars in 1250 bytes} [Tue Jul 12 17:47:14 2022] GET /compute/v2.1/os-snapshots/d4840ed5-3ca3-4462-93c3-d9d9f7dbf2d5 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:47:15.453851 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-98b67060-71bb-4314-86c1-cb8e93c82b3a tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] Calling method '.version_select at 0x7f479fdff700>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:15.483623 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-98b67060-71bb-4314-86c1-cb8e93c82b3a tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/d4840ed5-3ca3-4462-93c3-d9d9f7dbf2d5" status: 200 len: 287 microversion: 2.1 time: 0.034263 Jul 12 17:47:15.484188 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 495/982] 10.222.0.16 () {58 vars in 1250 bytes} [Tue Jul 12 17:47:15 2022] GET /compute/v2.1/os-snapshots/d4840ed5-3ca3-4462-93c3-d9d9f7dbf2d5 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:47:16.496705 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-f041659e-52af-4ba9-a4d1-ead693807966 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] Calling method '.version_select at 0x7f47ac071700>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:16.527985 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-f041659e-52af-4ba9-a4d1-ead693807966 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/d4840ed5-3ca3-4462-93c3-d9d9f7dbf2d5" status: 200 len: 287 microversion: 2.1 time: 0.036007 Jul 12 17:47:16.528644 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 488/983] 10.222.0.16 () {58 vars in 1250 bytes} [Tue Jul 12 17:47:16 2022] GET /compute/v2.1/os-snapshots/d4840ed5-3ca3-4462-93c3-d9d9f7dbf2d5 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:47:17.548129 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-74745e18-494c-4511-bb96-f97275f7efdb tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] Calling method '.version_select at 0x7f479fd92ee0>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:17.623212 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-74745e18-494c-4511-bb96-f97275f7efdb tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/d4840ed5-3ca3-4462-93c3-d9d9f7dbf2d5" status: 200 len: 288 microversion: 2.1 time: 0.086820 Jul 12 17:47:17.623808 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 496/984] 10.222.0.16 () {58 vars in 1250 bytes} [Tue Jul 12 17:47:17 2022] GET /compute/v2.1/os-snapshots/d4840ed5-3ca3-4462-93c3-d9d9f7dbf2d5 => generated 288 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:47:17.642819 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-15ec6cb5-c12b-4faa-9e6f-3d1e0d5792d7 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] Calling method '.version_select at 0x7f479ffd6d30>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:17.835450 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-15ec6cb5-c12b-4faa-9e6f-3d1e0d5792d7 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/d4840ed5-3ca3-4462-93c3-d9d9f7dbf2d5" status: 202 len: 0 microversion: 2.1 time: 0.197782 Jul 12 17:47:17.836187 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 489/985] 10.222.0.16 () {58 vars in 1253 bytes} [Tue Jul 12 17:47:17 2022] DELETE /compute/v2.1/os-snapshots/d4840ed5-3ca3-4462-93c3-d9d9f7dbf2d5 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:47:17.844628 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-23e5f970-c37b-4142-9a5a-d8cee21b7703 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] Calling method '.version_select at 0x7f479fc269d0>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:17.875115 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-23e5f970-c37b-4142-9a5a-d8cee21b7703 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/d4840ed5-3ca3-4462-93c3-d9d9f7dbf2d5" status: 200 len: 287 microversion: 2.1 time: 0.034556 Jul 12 17:47:17.875705 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 497/986] 10.222.0.16 () {58 vars in 1250 bytes} [Tue Jul 12 17:47:17 2022] GET /compute/v2.1/os-snapshots/d4840ed5-3ca3-4462-93c3-d9d9f7dbf2d5 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:47:18.888072 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-ab5782fb-5cb1-4f99-b118-09fd454a3982 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] Calling method '.version_select at 0x7f479fe5a280>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:18.913806 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.wsgi [None req-ab5782fb-5cb1-4f99-b118-09fd454a3982 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] HTTP exception thrown: Snapshot d4840ed5-3ca3-4462-93c3-d9d9f7dbf2d5 could not be found. Jul 12 17:47:18.917284 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-ab5782fb-5cb1-4f99-b118-09fd454a3982 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] Request method failure captured: Jul 12 17:47:18.917284 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: request: GET /compute/v2.1/os-snapshots/d4840ed5-3ca3-4462-93c3-d9d9f7dbf2d5 HTTP/1.1 Jul 12 17:47:18.917284 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept: application/json Jul 12 17:47:18.917284 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept-Encoding: identity Jul 12 17:47:18.917284 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Connection: close Jul 12 17:47:18.917284 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Length: 0 Jul 12 17:47:18.917284 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Type: application/json Jul 12 17:47:18.917284 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Host: 10.222.0.16 Jul 12 17:47:18.917284 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Openstack-System-Scope: None Jul 12 17:47:18.917284 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: User-Agent: python-urllib3/1.26.9 Jul 12 17:47:18.917284 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Auth-Token: gAAAAABizbOcBARcgfhOfCyr7CHvMCpvp6lJb630MbsLj_zqPnjqMtSQkbf5Iri43p5FVIc8zHv1jOOzeGw8IN5Z9foRcJFDyiXnHIkW3zceywo79QOwi14uMUtkMsLyuf_zktPBDORuQ8qOobLifEkNk7RfqApnDT12_rxHLTNUex6KygwqN3Y Jul 12 17:47:18.917284 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Id: None Jul 12 17:47:18.917284 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Name: None Jul 12 17:47:18.917284 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Identity-Status: Confirmed Jul 12 17:47:18.917284 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Is-Admin-Project: True Jul 12 17:47:18.917284 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Id: default Jul 12 17:47:18.917284 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Name: Default Jul 12 17:47:18.917284 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Id: 9f8d28bb1201459882314009cad942b3 Jul 12 17:47:18.917284 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-318192677 Jul 12 17:47:18.917284 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Role: reader,member Jul 12 17:47:18.917284 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Roles: reader,member Jul 12 17:47:18.919177 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9f8d28bb1201459882314009cad942b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9f8d28bb1201459882314009cad942b3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9f8d28bb1201459882314009cad942b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9f8d28bb1201459882314009cad942b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:47:18.919177 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant: tempest-VolumesSnapshotsTestJSON-318192677 Jul 12 17:47:18.919177 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Id: 9f8d28bb1201459882314009cad942b3 Jul 12 17:47:18.919177 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-318192677 Jul 12 17:47:18.919177 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User: tempest-VolumesSnapshotsTestJSON-318192677-project Jul 12 17:47:18.919177 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Id: default Jul 12 17:47:18.919177 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Name: Default Jul 12 17:47:18.919177 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Id: b1caccaedb6d41d1bbc4e2180c73efff Jul 12 17:47:18.919177 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Name: tempest-VolumesSnapshotsTestJSON-318192677-project Jul 12 17:47:18.919177 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: method: Jul 12 17:47:18.919177 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: exception: Snapshot d4840ed5-3ca3-4462-93c3-d9d9f7dbf2d5 could not be found. Jul 12 17:47:18.919177 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: action_args: {'id': 'd4840ed5-3ca3-4462-93c3-d9d9f7dbf2d5'} Jul 12 17:47:18.919177 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:47:18.920270 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:18.920270 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 12 17:47:18.920270 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 12 17:47:18.920270 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 12 17:47:18.920270 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 12 17:47:18.920270 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 12 17:47:18.920270 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 12 17:47:18.920270 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 17:47:18.920270 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 17:47:18.920270 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 17:47:18.920270 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 17:47:18.920270 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 17:47:18.920270 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 17:47:18.920270 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 17:47:18.920270 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 17:47:18.920270 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d4840ed5-3ca3-4462-93c3-d9d9f7dbf2d5 could not be found. (HTTP 404) (Request-ID: req-34101a40-0b3e-4012-92d7-fa1d334ed8a5) Jul 12 17:47:18.920270 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:47:18.920270 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:47:18.921642 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:47:18.921642 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:18.921642 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 12 17:47:18.921642 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 12 17:47:18.921642 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 17:47:18.921642 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 17:47:18.921642 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 12 17:47:18.921642 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 12 17:47:18.921642 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 17:47:18.921642 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 17:47:18.921642 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 12 17:47:18.921642 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 12 17:47:18.921642 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 12 17:47:18.921642 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 12 17:47:18.921642 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 12 17:47:18.921642 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 12 17:47:18.921642 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 17:47:18.921642 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 17:47:18.921642 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 17:47:18.924452 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 17:47:18.924452 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 17:47:18.924452 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 17:47:18.924452 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 17:47:18.924452 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 17:47:18.924452 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d4840ed5-3ca3-4462-93c3-d9d9f7dbf2d5 could not be found. Jul 12 17:47:18.924452 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:47:18.924452 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:47:18.924452 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:47:18.924452 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:18.924452 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:47:18.924452 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:47:18.924452 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:47:18.924452 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:47:18.924452 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 17:47:18.924452 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 17:47:18.924452 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:47:18.924452 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:47:18.924452 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 12 17:47:18.924452 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:47:18.925936 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d4840ed5-3ca3-4462-93c3-d9d9f7dbf2d5 could not be found. Jul 12 17:47:18.925936 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:47:18.925936 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:47:18.925936 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:47:18.925936 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:18.925936 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:47:18.925936 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:47:18.925936 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:47:18.925936 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:47:18.925936 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d4840ed5-3ca3-4462-93c3-d9d9f7dbf2d5 could not be found. Jul 12 17:47:18.925936 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:47:18.925936 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-ab5782fb-5cb1-4f99-b118-09fd454a3982 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] Returning 404 to user: Snapshot d4840ed5-3ca3-4462-93c3-d9d9f7dbf2d5 could not be found. {{(pid=130058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:47:18.925936 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-ab5782fb-5cb1-4f99-b118-09fd454a3982 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/d4840ed5-3ca3-4462-93c3-d9d9f7dbf2d5" status: 404 len: 111 microversion: 2.1 time: 0.035174 Jul 12 17:47:18.925936 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 490/987] 10.222.0.16 () {58 vars in 1250 bytes} [Tue Jul 12 17:47:18 2022] GET /compute/v2.1/os-snapshots/d4840ed5-3ca3-4462-93c3-d9d9f7dbf2d5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:47:18.927916 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-bc88cd9d-2593-490a-908d-267804dfefe4 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] Calling method '.version_select at 0x7f479fd92160>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:19.138967 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-bc88cd9d-2593-490a-908d-267804dfefe4 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/8244047c-318d-4e0b-9dcb-919d9a86f60f" status: 202 len: 0 microversion: 2.1 time: 0.215292 Jul 12 17:47:19.139555 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 498/988] 10.222.0.16 () {58 vars in 1247 bytes} [Tue Jul 12 17:47:18 2022] DELETE /compute/v2.1/os-volumes/8244047c-318d-4e0b-9dcb-919d9a86f60f => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 17:47:19.148640 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-319f4fb3-e425-4722-bc14-23fc4ee05b4a tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] Calling method '.version_select at 0x7f479fc79550>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:19.196175 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-319f4fb3-e425-4722-bc14-23fc4ee05b4a tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/8244047c-318d-4e0b-9dcb-919d9a86f60f" status: 200 len: 344 microversion: 2.1 time: 0.051591 Jul 12 17:47:19.196756 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 491/989] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jul 12 17:47:19 2022] GET /compute/v2.1/os-volumes/8244047c-318d-4e0b-9dcb-919d9a86f60f => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:47:20.209440 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-db764ce1-9b27-487e-bf3b-3ac82f139896 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] Calling method '.version_select at 0x7f479fb86160>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:20.256118 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-db764ce1-9b27-487e-bf3b-3ac82f139896 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/8244047c-318d-4e0b-9dcb-919d9a86f60f" status: 200 len: 344 microversion: 2.1 time: 0.051076 Jul 12 17:47:20.256702 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 499/990] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jul 12 17:47:20 2022] GET /compute/v2.1/os-volumes/8244047c-318d-4e0b-9dcb-919d9a86f60f => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:47:21.269629 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-7699f82e-e8a1-472b-ad10-36e0dfea0f70 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] Calling method '.version_select at 0x7f479fe473a0>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:21.319113 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-7699f82e-e8a1-472b-ad10-36e0dfea0f70 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/8244047c-318d-4e0b-9dcb-919d9a86f60f" status: 200 len: 344 microversion: 2.1 time: 0.053373 Jul 12 17:47:21.319700 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 492/991] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jul 12 17:47:21 2022] GET /compute/v2.1/os-volumes/8244047c-318d-4e0b-9dcb-919d9a86f60f => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:47:22.331482 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-584bb3f4-879e-4623-b134-d98ad81c1e67 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] Calling method '.version_select at 0x7f479fdbea60>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:22.485731 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-584bb3f4-879e-4623-b134-d98ad81c1e67 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] HTTP exception thrown: Volume 8244047c-318d-4e0b-9dcb-919d9a86f60f could not be found. Jul 12 17:47:22.487807 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-584bb3f4-879e-4623-b134-d98ad81c1e67 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] Request method failure captured: Jul 12 17:47:22.487807 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: GET /compute/v2.1/os-volumes/8244047c-318d-4e0b-9dcb-919d9a86f60f HTTP/1.1 Jul 12 17:47:22.487807 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:47:22.487807 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:47:22.487807 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:47:22.487807 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 0 Jul 12 17:47:22.487807 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:47:22.487807 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:47:22.487807 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:47:22.487807 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:47:22.487807 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbOcBARcgfhOfCyr7CHvMCpvp6lJb630MbsLj_zqPnjqMtSQkbf5Iri43p5FVIc8zHv1jOOzeGw8IN5Z9foRcJFDyiXnHIkW3zceywo79QOwi14uMUtkMsLyuf_zktPBDORuQ8qOobLifEkNk7RfqApnDT12_rxHLTNUex6KygwqN3Y Jul 12 17:47:22.487807 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:47:22.487807 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:47:22.487807 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:47:22.487807 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:47:22.487807 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:47:22.487807 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:47:22.487807 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: 9f8d28bb1201459882314009cad942b3 Jul 12 17:47:22.487807 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-318192677 Jul 12 17:47:22.487807 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:47:22.487807 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:47:22.489228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9f8d28bb1201459882314009cad942b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9f8d28bb1201459882314009cad942b3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9f8d28bb1201459882314009cad942b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9f8d28bb1201459882314009cad942b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:47:22.489228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-VolumesSnapshotsTestJSON-318192677 Jul 12 17:47:22.489228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: 9f8d28bb1201459882314009cad942b3 Jul 12 17:47:22.489228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-318192677 Jul 12 17:47:22.489228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-VolumesSnapshotsTestJSON-318192677-project Jul 12 17:47:22.489228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:47:22.489228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:47:22.489228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: b1caccaedb6d41d1bbc4e2180c73efff Jul 12 17:47:22.489228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-VolumesSnapshotsTestJSON-318192677-project Jul 12 17:47:22.489228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: Jul 12 17:47:22.489228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Volume 8244047c-318d-4e0b-9dcb-919d9a86f60f could not be found. Jul 12 17:47:22.489228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'id': '8244047c-318d-4e0b-9dcb-919d9a86f60f'} Jul 12 17:47:22.489228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:47:22.490905 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:22.490905 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 17:47:22.490905 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 17:47:22.490905 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 17:47:22.490905 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 17:47:22.490905 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 17:47:22.490905 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 17:47:22.490905 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 17:47:22.490905 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 17:47:22.490905 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 17:47:22.490905 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 17:47:22.490905 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 17:47:22.490905 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 17:47:22.490905 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 17:47:22.490905 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 17:47:22.490905 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8244047c-318d-4e0b-9dcb-919d9a86f60f could not be found. (HTTP 404) (Request-ID: req-76a1c5df-05c3-4b46-978e-1dfed7d38e74) Jul 12 17:47:22.490905 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:22.490905 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:47:22.490905 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:22.492736 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:22.492736 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 17:47:22.492736 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 17:47:22.492736 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 17:47:22.492736 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 17:47:22.492736 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 17:47:22.492736 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 17:47:22.492736 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 17:47:22.492736 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 17:47:22.492736 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 17:47:22.492736 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 17:47:22.492736 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 17:47:22.492736 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 17:47:22.492736 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 17:47:22.492736 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 17:47:22.492736 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 17:47:22.492736 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 17:47:22.492736 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 17:47:22.492736 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 17:47:22.493870 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 17:47:22.493870 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 17:47:22.493870 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 17:47:22.493870 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 17:47:22.493870 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8244047c-318d-4e0b-9dcb-919d9a86f60f could not be found. Jul 12 17:47:22.493870 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:22.493870 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:47:22.493870 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:22.493870 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:22.493870 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:47:22.493870 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:47:22.493870 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:47:22.493870 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:47:22.493870 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 17:47:22.493870 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 17:47:22.493870 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:47:22.493870 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:47:22.493870 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 17:47:22.493870 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:47:22.496126 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8244047c-318d-4e0b-9dcb-919d9a86f60f could not be found. Jul 12 17:47:22.496126 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:22.496126 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:47:22.496126 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:22.496126 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:22.496126 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:47:22.496126 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:47:22.496126 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:47:22.496126 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:47:22.496126 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8244047c-318d-4e0b-9dcb-919d9a86f60f could not be found. Jul 12 17:47:22.496126 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:22.496126 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-584bb3f4-879e-4623-b134-d98ad81c1e67 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] Returning 404 to user: Volume 8244047c-318d-4e0b-9dcb-919d9a86f60f could not be found. {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:47:22.496126 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-584bb3f4-879e-4623-b134-d98ad81c1e67 tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/8244047c-318d-4e0b-9dcb-919d9a86f60f" status: 404 len: 109 microversion: 2.1 time: 0.162221 Jul 12 17:47:22.496126 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 500/992] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jul 12 17:47:22 2022] GET /compute/v2.1/os-volumes/8244047c-318d-4e0b-9dcb-919d9a86f60f => generated 109 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:47:22.501381 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-c262d251-9561-4e0b-854e-1f015939273a tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] Calling method '.version_select at 0x7f47ac02dee0>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:22.548792 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.wsgi [None req-c262d251-9561-4e0b-854e-1f015939273a tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] HTTP exception thrown: Volume 8244047c-318d-4e0b-9dcb-919d9a86f60f could not be found. Jul 12 17:47:22.551252 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-c262d251-9561-4e0b-854e-1f015939273a tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] Request method failure captured: Jul 12 17:47:22.551252 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: request: DELETE /compute/v2.1/os-volumes/8244047c-318d-4e0b-9dcb-919d9a86f60f HTTP/1.1 Jul 12 17:47:22.551252 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept: application/json Jul 12 17:47:22.551252 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept-Encoding: identity Jul 12 17:47:22.551252 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Connection: close Jul 12 17:47:22.551252 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Length: 0 Jul 12 17:47:22.551252 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Type: application/json Jul 12 17:47:22.551252 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Host: 10.222.0.16 Jul 12 17:47:22.551252 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Openstack-System-Scope: None Jul 12 17:47:22.551252 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: User-Agent: python-urllib3/1.26.9 Jul 12 17:47:22.551252 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Auth-Token: gAAAAABizbOcBARcgfhOfCyr7CHvMCpvp6lJb630MbsLj_zqPnjqMtSQkbf5Iri43p5FVIc8zHv1jOOzeGw8IN5Z9foRcJFDyiXnHIkW3zceywo79QOwi14uMUtkMsLyuf_zktPBDORuQ8qOobLifEkNk7RfqApnDT12_rxHLTNUex6KygwqN3Y Jul 12 17:47:22.551252 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Id: None Jul 12 17:47:22.551252 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Name: None Jul 12 17:47:22.551252 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Identity-Status: Confirmed Jul 12 17:47:22.551252 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Is-Admin-Project: True Jul 12 17:47:22.551252 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Id: default Jul 12 17:47:22.551252 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Name: Default Jul 12 17:47:22.551252 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Id: 9f8d28bb1201459882314009cad942b3 Jul 12 17:47:22.551252 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-318192677 Jul 12 17:47:22.551252 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Role: reader,member Jul 12 17:47:22.551252 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Roles: reader,member Jul 12 17:47:22.553068 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9f8d28bb1201459882314009cad942b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9f8d28bb1201459882314009cad942b3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9f8d28bb1201459882314009cad942b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9f8d28bb1201459882314009cad942b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:47:22.553068 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant: tempest-VolumesSnapshotsTestJSON-318192677 Jul 12 17:47:22.553068 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Id: 9f8d28bb1201459882314009cad942b3 Jul 12 17:47:22.553068 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-318192677 Jul 12 17:47:22.553068 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User: tempest-VolumesSnapshotsTestJSON-318192677-project Jul 12 17:47:22.553068 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Id: default Jul 12 17:47:22.553068 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Name: Default Jul 12 17:47:22.553068 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Id: b1caccaedb6d41d1bbc4e2180c73efff Jul 12 17:47:22.553068 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Name: tempest-VolumesSnapshotsTestJSON-318192677-project Jul 12 17:47:22.553068 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: method: Jul 12 17:47:22.553068 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: exception: Volume 8244047c-318d-4e0b-9dcb-919d9a86f60f could not be found. Jul 12 17:47:22.553068 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: action_args: {'id': '8244047c-318d-4e0b-9dcb-919d9a86f60f'} Jul 12 17:47:22.553068 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:47:22.554242 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:22.554242 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 17:47:22.554242 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 17:47:22.554242 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 17:47:22.554242 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 17:47:22.554242 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 17:47:22.554242 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 17:47:22.554242 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 17:47:22.554242 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 17:47:22.554242 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 17:47:22.554242 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 17:47:22.554242 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 17:47:22.554242 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 17:47:22.554242 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 17:47:22.554242 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 17:47:22.554242 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8244047c-318d-4e0b-9dcb-919d9a86f60f could not be found. (HTTP 404) (Request-ID: req-bb06bc9e-e5af-49f0-85f5-46b4e7473501) Jul 12 17:47:22.554242 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:47:22.554242 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:47:22.554242 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:47:22.556392 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:22.556392 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 17:47:22.556392 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 17:47:22.556392 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 17:47:22.556392 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 17:47:22.556392 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 17:47:22.556392 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 17:47:22.556392 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 17:47:22.556392 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 17:47:22.556392 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 17:47:22.556392 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 17:47:22.556392 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 17:47:22.556392 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 17:47:22.556392 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 17:47:22.556392 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 17:47:22.556392 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 17:47:22.556392 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 17:47:22.556392 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 17:47:22.556392 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 17:47:22.557706 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 17:47:22.557706 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 17:47:22.557706 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 17:47:22.557706 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 17:47:22.557706 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8244047c-318d-4e0b-9dcb-919d9a86f60f could not be found. Jul 12 17:47:22.557706 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:47:22.557706 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:47:22.557706 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:47:22.557706 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:22.557706 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:47:22.557706 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:47:22.557706 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:47:22.557706 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:47:22.557706 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 17:47:22.557706 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 17:47:22.557706 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:47:22.557706 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:47:22.557706 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 17:47:22.557706 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:47:22.559973 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8244047c-318d-4e0b-9dcb-919d9a86f60f could not be found. Jul 12 17:47:22.559973 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:47:22.559973 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:47:22.559973 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:47:22.559973 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:22.559973 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:47:22.559973 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:47:22.559973 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:47:22.559973 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:47:22.559973 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8244047c-318d-4e0b-9dcb-919d9a86f60f could not be found. Jul 12 17:47:22.559973 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:47:22.559973 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-c262d251-9561-4e0b-854e-1f015939273a tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] Returning 404 to user: Volume 8244047c-318d-4e0b-9dcb-919d9a86f60f could not be found. {{(pid=130058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:47:22.559973 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-c262d251-9561-4e0b-854e-1f015939273a tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/8244047c-318d-4e0b-9dcb-919d9a86f60f" status: 404 len: 109 microversion: 2.1 time: 0.056193 Jul 12 17:47:22.559973 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 493/993] 10.222.0.16 () {58 vars in 1247 bytes} [Tue Jul 12 17:47:22 2022] DELETE /compute/v2.1/os-volumes/8244047c-318d-4e0b-9dcb-919d9a86f60f => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:47:22.562025 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-b3affc88-bf31-448f-81f8-96ec1378fd8f tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] Calling method '.version_select at 0x7f479fb86550>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:22.593161 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-b3affc88-bf31-448f-81f8-96ec1378fd8f tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] HTTP exception thrown: Volume 8244047c-318d-4e0b-9dcb-919d9a86f60f could not be found. Jul 12 17:47:22.597106 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-b3affc88-bf31-448f-81f8-96ec1378fd8f tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] Request method failure captured: Jul 12 17:47:22.597106 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: GET /compute/v2.1/os-volumes/8244047c-318d-4e0b-9dcb-919d9a86f60f HTTP/1.1 Jul 12 17:47:22.597106 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:47:22.597106 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:47:22.597106 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:47:22.597106 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 0 Jul 12 17:47:22.597106 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:47:22.597106 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:47:22.597106 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:47:22.597106 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:47:22.597106 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbOcBARcgfhOfCyr7CHvMCpvp6lJb630MbsLj_zqPnjqMtSQkbf5Iri43p5FVIc8zHv1jOOzeGw8IN5Z9foRcJFDyiXnHIkW3zceywo79QOwi14uMUtkMsLyuf_zktPBDORuQ8qOobLifEkNk7RfqApnDT12_rxHLTNUex6KygwqN3Y Jul 12 17:47:22.597106 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:47:22.597106 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:47:22.597106 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:47:22.597106 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:47:22.597106 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:47:22.597106 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:47:22.597106 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: 9f8d28bb1201459882314009cad942b3 Jul 12 17:47:22.597106 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-318192677 Jul 12 17:47:22.597106 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:47:22.597106 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:47:22.598831 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9f8d28bb1201459882314009cad942b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9f8d28bb1201459882314009cad942b3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9f8d28bb1201459882314009cad942b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9f8d28bb1201459882314009cad942b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:47:22.598831 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-VolumesSnapshotsTestJSON-318192677 Jul 12 17:47:22.598831 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: 9f8d28bb1201459882314009cad942b3 Jul 12 17:47:22.598831 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-318192677 Jul 12 17:47:22.598831 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-VolumesSnapshotsTestJSON-318192677-project Jul 12 17:47:22.598831 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:47:22.598831 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:47:22.598831 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: b1caccaedb6d41d1bbc4e2180c73efff Jul 12 17:47:22.598831 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-VolumesSnapshotsTestJSON-318192677-project Jul 12 17:47:22.598831 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: Jul 12 17:47:22.598831 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Volume 8244047c-318d-4e0b-9dcb-919d9a86f60f could not be found. Jul 12 17:47:22.598831 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'id': '8244047c-318d-4e0b-9dcb-919d9a86f60f'} Jul 12 17:47:22.598831 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:47:22.599909 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:22.599909 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 17:47:22.599909 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 17:47:22.599909 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 17:47:22.599909 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 17:47:22.599909 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 17:47:22.599909 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 17:47:22.599909 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 17:47:22.599909 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 17:47:22.599909 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 17:47:22.599909 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 17:47:22.599909 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 17:47:22.599909 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 17:47:22.599909 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 17:47:22.599909 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 17:47:22.599909 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8244047c-318d-4e0b-9dcb-919d9a86f60f could not be found. (HTTP 404) (Request-ID: req-a20b2c5d-fb8d-4ada-8d03-cffb36f46186) Jul 12 17:47:22.599909 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:22.599909 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:47:22.599909 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:22.601858 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:22.601858 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 17:47:22.601858 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 17:47:22.601858 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 17:47:22.601858 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 17:47:22.601858 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 17:47:22.601858 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 17:47:22.601858 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 17:47:22.601858 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 17:47:22.601858 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 17:47:22.601858 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 17:47:22.601858 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 17:47:22.601858 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 17:47:22.601858 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 17:47:22.601858 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 17:47:22.601858 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 17:47:22.601858 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 17:47:22.601858 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 17:47:22.601858 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 17:47:22.603787 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 17:47:22.603787 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 17:47:22.603787 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 17:47:22.603787 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 17:47:22.603787 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8244047c-318d-4e0b-9dcb-919d9a86f60f could not be found. Jul 12 17:47:22.603787 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:22.603787 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:47:22.603787 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:22.603787 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:22.603787 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:47:22.603787 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:47:22.603787 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:47:22.603787 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:47:22.603787 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 17:47:22.603787 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 17:47:22.603787 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:47:22.603787 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:47:22.603787 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 17:47:22.603787 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:47:22.605426 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8244047c-318d-4e0b-9dcb-919d9a86f60f could not be found. Jul 12 17:47:22.605426 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:22.605426 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:47:22.605426 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:22.605426 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:22.605426 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:47:22.605426 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:47:22.605426 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:47:22.605426 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:47:22.605426 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8244047c-318d-4e0b-9dcb-919d9a86f60f could not be found. Jul 12 17:47:22.605426 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:22.605426 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-b3affc88-bf31-448f-81f8-96ec1378fd8f tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] Returning 404 to user: Volume 8244047c-318d-4e0b-9dcb-919d9a86f60f could not be found. {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:47:22.605426 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-b3affc88-bf31-448f-81f8-96ec1378fd8f tempest-VolumesSnapshotsTestJSON-318192677 tempest-VolumesSnapshotsTestJSON-318192677-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/8244047c-318d-4e0b-9dcb-919d9a86f60f" status: 404 len: 109 microversion: 2.1 time: 0.038604 Jul 12 17:47:22.605426 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 501/994] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jul 12 17:47:22 2022] GET /compute/v2.1/os-volumes/8244047c-318d-4e0b-9dcb-919d9a86f60f => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:47:23.850705 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-34a9bce6-f487-4a21-809e-38eeb0fb37c4 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:23.851279 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-34a9bce6-f487-4a21-809e-38eeb0fb37c4 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:23.858159 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-34a9bce6-f487-4a21-809e-38eeb0fb37c4 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:23.858801 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-34a9bce6-f487-4a21-809e-38eeb0fb37c4 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:23.859859 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-34a9bce6-f487-4a21-809e-38eeb0fb37c4 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:23.860479 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-34a9bce6-f487-4a21-809e-38eeb0fb37c4 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:23.950934 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.objects.instance [None req-34a9bce6-f487-4a21-809e-38eeb0fb37c4 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lazy-loading 'services' on Instance uuid c8f7b428-9b6d-459f-8ad2-cab4f82052e8 {{(pid=130058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:47:24.188384 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-34a9bce6-f487-4a21-809e-38eeb0fb37c4 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8/os-volume_attachments/ea2b9d2b-eff8-46a5-b1d4-743c251f4c87" status: 202 len: 0 microversion: 2.1 time: 0.341233 Jul 12 17:47:24.188384 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 494/995] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jul 12 17:47:23 2022] DELETE /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8/os-volume_attachments/ea2b9d2b-eff8-46a5-b1d4-743c251f4c87 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 17:47:25.854300 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-dd5515b6-be69-4efc-9fc6-c78042e8161c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-45285195", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1463826168", "security_groups": [{"name": "tempest-secgroup-smoke-2128293980"}], "block_device_mapping_v2": [{"uuid": "8ae82545-3491-469d-af1d-4f8279a7c3f3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2d0ff45d-e690-48e9-9ea7-09279c5e4d10"}]}} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:47:25.971301 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.network.neutron [None req-dd5515b6-be69-4efc-9fc6-c78042e8161c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] validate_networks() for [('2d0ff45d-e690-48e9-9ea7-09279c5e4d10', None, None, None, None, None)] {{(pid=130059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:47:26.355619 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-dd5515b6-be69-4efc-9fc6-c78042e8161c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Flavor limits 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:47:26.356124 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-dd5515b6-be69-4efc-9fc6-c78042e8161c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Image limits 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:47:26.356595 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-dd5515b6-be69-4efc-9fc6-c78042e8161c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Flavor pref 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:47:26.357010 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-dd5515b6-be69-4efc-9fc6-c78042e8161c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Image pref 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:47:26.357434 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-dd5515b6-be69-4efc-9fc6-c78042e8161c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:47:26.367645 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-dd5515b6-be69-4efc-9fc6-c78042e8161c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:26.368214 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-dd5515b6-be69-4efc-9fc6-c78042e8161c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:26.368933 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-dd5515b6-be69-4efc-9fc6-c78042e8161c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:26.369370 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-dd5515b6-be69-4efc-9fc6-c78042e8161c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:26.388713 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.quota [None req-dd5515b6-be69-4efc-9fc6-c78042e8161c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Getting quotas for project e4b2b488b746454b9f93d67fa3c97809. Resources: {'cores', 'instances', 'ram'} {{(pid=130059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:47:26.392983 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.quota [None req-dd5515b6-be69-4efc-9fc6-c78042e8161c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Getting quotas for user bde6ee9df10146d98991b0d4bb37fc48 and project e4b2b488b746454b9f93d67fa3c97809. Resources: {'cores', 'instances', 'ram'} {{(pid=130059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:47:26.426590 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-a76efc93-5c7b-4334-9d58-5b3d0ff9d8e6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:47:26.437104 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a76efc93-5c7b-4334-9d58-5b3d0ff9d8e6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:26.437787 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a76efc93-5c7b-4334-9d58-5b3d0ff9d8e6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:26.466745 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-a76efc93-5c7b-4334-9d58-5b3d0ff9d8e6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Going to try to stop instance {{(pid=130058) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 12 17:47:26.481596 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-dd5515b6-be69-4efc-9fc6-c78042e8161c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Going to run 1 instances... {{(pid=130059) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:47:26.483755 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-dd5515b6-be69-4efc-9fc6-c78042e8161c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: d360de38-a762-403b-bed3-d9ac43ffa09d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8ae82545-3491-469d-af1d-4f8279a7c3f3',volume_size=None,volume_type=None)] {{(pid=130059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:47:26.658505 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-a76efc93-5c7b-4334-9d58-5b3d0ff9d8e6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "POST /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8/action" status: 202 len: 0 microversion: 2.1 time: 0.236112 Jul 12 17:47:26.659205 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 495/996] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jul 12 17:47:26 2022] POST /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:47:26.675082 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-a5b77125-ab9d-43a9-847f-6e0f9eabd731 tempest-VolumesTestJSON-1354765170 tempest-VolumesTestJSON-1354765170-project] Calling method '.version_select at 0x7f47ac12dc10>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:26.724333 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-a5b77125-ab9d-43a9-847f-6e0f9eabd731 tempest-VolumesTestJSON-1354765170 tempest-VolumesTestJSON-1354765170-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/58a1deca-cf4c-424c-8e2c-5b3a1123524d" status: 200 len: 351 microversion: 2.1 time: 0.063488 Jul 12 17:47:26.724916 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 496/997] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jul 12 17:47:26 2022] GET /compute/v2.1/os-volumes/58a1deca-cf4c-424c-8e2c-5b3a1123524d => generated 351 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:47:26.730097 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-3199ec4e-59c5-4409-890d-1b27bce3564e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:26.730975 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-3199ec4e-59c5-4409-890d-1b27bce3564e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:26.737753 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3199ec4e-59c5-4409-890d-1b27bce3564e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:26.738217 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3199ec4e-59c5-4409-890d-1b27bce3564e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:26.739041 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3199ec4e-59c5-4409-890d-1b27bce3564e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:26.739481 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3199ec4e-59c5-4409-890d-1b27bce3564e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:26.904669 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-3199ec4e-59c5-4409-890d-1b27bce3564e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:26.912299 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-3199ec4e-59c5-4409-890d-1b27bce3564e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1676 microversion: 2.1 time: 0.186419 Jul 12 17:47:26.912881 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 497/998] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:26 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1676 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:26.946152 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dd5515b6-be69-4efc-9fc6-c78042e8161c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [8bc46ba2-fccb-4767-83ff-6f0f5825415c] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 12 17:47:27.931428 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-7df0143c-fe85-4758-989a-1c4878d7a793 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:27.932186 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-7df0143c-fe85-4758-989a-1c4878d7a793 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:27.938508 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7df0143c-fe85-4758-989a-1c4878d7a793 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:27.938961 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7df0143c-fe85-4758-989a-1c4878d7a793 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:27.939719 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7df0143c-fe85-4758-989a-1c4878d7a793 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:27.940148 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7df0143c-fe85-4758-989a-1c4878d7a793 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:27.953613 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO oslo.messaging._drivers.impl_rabbit [None req-dd5515b6-be69-4efc-9fc6-c78042e8161c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [8bc46ba2-fccb-4767-83ff-6f0f5825415c] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 49450. Jul 12 17:47:27.957986 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-dd5515b6-be69-4efc-9fc6-c78042e8161c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.108865 Jul 12 17:47:27.964127 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 502/999] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 12 17:47:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 2111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 17:47:27.969377 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-6903c835-4c22-413a-965f-3d710941704b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:27.969994 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-6903c835-4c22-413a-965f-3d710941704b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: d360de38-a762-403b-bed3-d9ac43ffa09d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:28.030331 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-6903c835-4c22-413a-965f-3d710941704b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:28.037298 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-6903c835-4c22-413a-965f-3d710941704b tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d" status: 200 len: 1093 microversion: 2.1 time: 0.071745 Jul 12 17:47:28.038118 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 503/1000] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:27 2022] GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d => generated 1093 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:28.080430 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-7df0143c-fe85-4758-989a-1c4878d7a793 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:28.088812 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-7df0143c-fe85-4758-989a-1c4878d7a793 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1676 microversion: 2.1 time: 0.161296 Jul 12 17:47:28.089378 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 498/1001] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:27 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:47:28.373194 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-8eaf362a-f13b-4c9b-a5b9-5c17fb965e19 tempest-VolumesTestJSON-1354765170 tempest-VolumesTestJSON-1354765170-project] Calling method '.version_select at 0x7f479fda2c10>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:28.419872 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-8eaf362a-f13b-4c9b-a5b9-5c17fb965e19 tempest-VolumesTestJSON-1354765170 tempest-VolumesTestJSON-1354765170-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/2abd8391-a8f4-49ec-b857-039b1479b27a" status: 200 len: 350 microversion: 2.1 time: 0.050427 Jul 12 17:47:28.420451 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 504/1002] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jul 12 17:47:28 2022] GET /compute/v2.1/os-volumes/2abd8391-a8f4-49ec-b857-039b1479b27a => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:47:29.057316 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-edb69d14-c8b3-4244-904b-20abbd90c664 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:29.057316 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-edb69d14-c8b3-4244-904b-20abbd90c664 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: d360de38-a762-403b-bed3-d9ac43ffa09d] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:29.108782 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-96f38e4c-0eca-4ab3-933a-1b6bca1edc7a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:29.108782 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-96f38e4c-0eca-4ab3-933a-1b6bca1edc7a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:29.110868 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-edb69d14-c8b3-4244-904b-20abbd90c664 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:29.114380 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-96f38e4c-0eca-4ab3-933a-1b6bca1edc7a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:29.115008 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-96f38e4c-0eca-4ab3-933a-1b6bca1edc7a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:29.115686 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-96f38e4c-0eca-4ab3-933a-1b6bca1edc7a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:29.116116 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-96f38e4c-0eca-4ab3-933a-1b6bca1edc7a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:29.122790 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-edb69d14-c8b3-4244-904b-20abbd90c664 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d" status: 200 len: 1093 microversion: 2.1 time: 0.071918 Jul 12 17:47:29.124554 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 499/1003] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:29 2022] GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d => generated 1093 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:29.253575 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-96f38e4c-0eca-4ab3-933a-1b6bca1edc7a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:29.262053 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-96f38e4c-0eca-4ab3-933a-1b6bca1edc7a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1676 microversion: 2.1 time: 0.160647 Jul 12 17:47:29.262668 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 505/1004] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:29 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:30.051982 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-8b520ad2-a0c6-46b7-b9b2-fd61bab26f3d tempest-VolumesTestJSON-1354765170 tempest-VolumesTestJSON-1354765170-project] Calling method '.version_select at 0x7f47ac02d1f0>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:30.109925 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-8b520ad2-a0c6-46b7-b9b2-fd61bab26f3d tempest-VolumesTestJSON-1354765170 tempest-VolumesTestJSON-1354765170-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/e3965621-4d06-4d57-a8b2-dd63ffbe72c7" status: 200 len: 351 microversion: 2.1 time: 0.061907 Jul 12 17:47:30.110745 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 500/1005] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jul 12 17:47:30 2022] GET /compute/v2.1/os-volumes/e3965621-4d06-4d57-a8b2-dd63ffbe72c7 => generated 351 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:47:30.121717 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-7e9990dd-3e8c-42de-833d-58f5225c7e84 tempest-VolumesTestJSON-1354765170 tempest-VolumesTestJSON-1354765170-project] Calling method '.version_select at 0x7f479fdbe0d0>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:30.139741 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b377dc54-aec1-4da6-8fe7-8b9e3a560ce4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:30.141041 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-b377dc54-aec1-4da6-8fe7-8b9e3a560ce4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: d360de38-a762-403b-bed3-d9ac43ffa09d] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:30.201733 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-b377dc54-aec1-4da6-8fe7-8b9e3a560ce4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:30.208812 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-b377dc54-aec1-4da6-8fe7-8b9e3a560ce4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d" status: 200 len: 1093 microversion: 2.1 time: 0.073963 Jul 12 17:47:30.209660 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 501/1006] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:30 2022] GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d => generated 1093 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:47:30.212341 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-7e9990dd-3e8c-42de-833d-58f5225c7e84 tempest-VolumesTestJSON-1354765170 tempest-VolumesTestJSON-1354765170-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.094035 Jul 12 17:47:30.218864 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 506/1007] 10.222.0.16 () {58 vars in 1133 bytes} [Tue Jul 12 17:47:30 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:30.225415 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-c129f561-69ad-485e-b459-5d86ed1b41eb tempest-VolumesTestJSON-1354765170 tempest-VolumesTestJSON-1354765170-project] Calling method '.version_select at 0x7f47ac071c10>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:30.279415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-88aaa0d2-b220-49b4-ae79-11ed4e7b3b04 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:30.281077 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-88aaa0d2-b220-49b4-ae79-11ed4e7b3b04 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:30.290195 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-88aaa0d2-b220-49b4-ae79-11ed4e7b3b04 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:30.290901 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-88aaa0d2-b220-49b4-ae79-11ed4e7b3b04 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:30.292486 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-88aaa0d2-b220-49b4-ae79-11ed4e7b3b04 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:30.292931 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-88aaa0d2-b220-49b4-ae79-11ed4e7b3b04 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:30.314365 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-c129f561-69ad-485e-b459-5d86ed1b41eb tempest-VolumesTestJSON-1354765170 tempest-VolumesTestJSON-1354765170-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.092311 Jul 12 17:47:30.318766 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 502/1008] 10.222.0.16 () {58 vars in 1148 bytes} [Tue Jul 12 17:47:30 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:47:30.329015 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-8af2e162-624d-478a-993b-db15295fd9b8 tempest-VolumesTestJSON-1354765170 tempest-VolumesTestJSON-1354765170-project] Calling method '.version_select at 0x7f47ac031670>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:30.429477 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-8af2e162-624d-478a-993b-db15295fd9b8 tempest-VolumesTestJSON-1354765170 tempest-VolumesTestJSON-1354765170-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.104564 Jul 12 17:47:30.430202 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 503/1009] 10.222.0.16 () {58 vars in 1133 bytes} [Tue Jul 12 17:47:30 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:30.438091 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-88aaa0d2-b220-49b4-ae79-11ed4e7b3b04 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:30.441695 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-659477f4-06d7-4729-8d82-9b8898035e8a tempest-VolumesTestJSON-1354765170 tempest-VolumesTestJSON-1354765170-project] Calling method '.version_select at 0x7f47ac02ddc0>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:30.446048 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-88aaa0d2-b220-49b4-ae79-11ed4e7b3b04 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1676 microversion: 2.1 time: 0.171269 Jul 12 17:47:30.446703 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 507/1010] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:30 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:47:30.524845 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-659477f4-06d7-4729-8d82-9b8898035e8a tempest-VolumesTestJSON-1354765170 tempest-VolumesTestJSON-1354765170-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086679 Jul 12 17:47:30.525430 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 504/1011] 10.222.0.16 () {58 vars in 1166 bytes} [Tue Jul 12 17:47:30 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:47:30.537662 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-da777ca4-a48e-4982-a83e-0a5a381bc97e tempest-VolumesTestJSON-1354765170 tempest-VolumesTestJSON-1354765170-project] Calling method '.version_select at 0x7f479fda2820>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:30.619513 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-da777ca4-a48e-4982-a83e-0a5a381bc97e tempest-VolumesTestJSON-1354765170 tempest-VolumesTestJSON-1354765170-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085685 Jul 12 17:47:30.620173 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 508/1012] 10.222.0.16 () {58 vars in 1169 bytes} [Tue Jul 12 17:47:30 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:47:30.632181 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-e5c768bc-6622-44e1-814c-35b0a7680fed tempest-VolumesTestJSON-1354765170 tempest-VolumesTestJSON-1354765170-project] Calling method '.version_select at 0x7f47ac02d8b0>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:30.716916 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-e5c768bc-6622-44e1-814c-35b0a7680fed tempest-VolumesTestJSON-1354765170 tempest-VolumesTestJSON-1354765170-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.088475 Jul 12 17:47:30.717568 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 505/1013] 10.222.0.16 () {58 vars in 1154 bytes} [Tue Jul 12 17:47:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:30.728747 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-1b07e7c6-0209-4836-a392-559602d2dcef tempest-VolumesTestJSON-1354765170 tempest-VolumesTestJSON-1354765170-project] Calling method '.version_select at 0x7f479fb55700>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:30.811345 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-1b07e7c6-0209-4836-a392-559602d2dcef tempest-VolumesTestJSON-1354765170 tempest-VolumesTestJSON-1354765170-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086391 Jul 12 17:47:30.812028 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 509/1014] 10.222.0.16 () {58 vars in 1187 bytes} [Tue Jul 12 17:47:30 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:47:30.824446 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-247fa516-e633-47db-89bb-3fce232deb90 tempest-VolumesTestJSON-1354765170 tempest-VolumesTestJSON-1354765170-project] Calling method '.version_select at 0x7f47ac031670>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:30.908444 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-247fa516-e633-47db-89bb-3fce232deb90 tempest-VolumesTestJSON-1354765170 tempest-VolumesTestJSON-1354765170-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.087766 Jul 12 17:47:30.908444 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 506/1015] 10.222.0.16 () {58 vars in 1154 bytes} [Tue Jul 12 17:47:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:47:31.229673 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-f5ce2926-7678-488c-92c8-5f87ecc774ad tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:31.229673 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-f5ce2926-7678-488c-92c8-5f87ecc774ad tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: d360de38-a762-403b-bed3-d9ac43ffa09d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:31.281840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-f5ce2926-7678-488c-92c8-5f87ecc774ad tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:31.288641 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-f5ce2926-7678-488c-92c8-5f87ecc774ad tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d" status: 200 len: 1093 microversion: 2.1 time: 0.066425 Jul 12 17:47:31.289241 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 510/1016] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:31 2022] GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:31.465575 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-a1508fe1-1db3-4a7c-81fe-9e4f031d903c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:31.465575 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-a1508fe1-1db3-4a7c-81fe-9e4f031d903c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:31.472204 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a1508fe1-1db3-4a7c-81fe-9e4f031d903c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:31.472204 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a1508fe1-1db3-4a7c-81fe-9e4f031d903c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:31.473590 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a1508fe1-1db3-4a7c-81fe-9e4f031d903c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:31.473590 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a1508fe1-1db3-4a7c-81fe-9e4f031d903c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:31.629470 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-a1508fe1-1db3-4a7c-81fe-9e4f031d903c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:31.637292 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-a1508fe1-1db3-4a7c-81fe-9e4f031d903c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1676 microversion: 2.1 time: 0.177491 Jul 12 17:47:31.637900 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 507/1017] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:31 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:32.305563 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-b4b1421e-567b-444a-ac96-0af6982087f7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:32.306237 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-b4b1421e-567b-444a-ac96-0af6982087f7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: d360de38-a762-403b-bed3-d9ac43ffa09d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:32.313936 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b4b1421e-567b-444a-ac96-0af6982087f7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:32.314389 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b4b1421e-567b-444a-ac96-0af6982087f7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:32.315228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b4b1421e-567b-444a-ac96-0af6982087f7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:32.315664 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b4b1421e-567b-444a-ac96-0af6982087f7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:32.381107 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-b4b1421e-567b-444a-ac96-0af6982087f7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:32.390660 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-b4b1421e-567b-444a-ac96-0af6982087f7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d" status: 200 len: 1143 microversion: 2.1 time: 0.088942 Jul 12 17:47:32.400528 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 511/1018] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:32 2022] GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d => generated 1143 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:32.656850 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b37517ea-62d1-4694-b007-51e1a964ceda tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:32.657395 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-b37517ea-62d1-4694-b007-51e1a964ceda tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:32.664270 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b37517ea-62d1-4694-b007-51e1a964ceda tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:32.665866 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b37517ea-62d1-4694-b007-51e1a964ceda tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:32.665866 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b37517ea-62d1-4694-b007-51e1a964ceda tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:32.666095 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b37517ea-62d1-4694-b007-51e1a964ceda tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:32.802602 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-b37517ea-62d1-4694-b007-51e1a964ceda tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:32.810772 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-b37517ea-62d1-4694-b007-51e1a964ceda tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1676 microversion: 2.1 time: 0.158237 Jul 12 17:47:32.811352 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 508/1019] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:32 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:33.407323 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a0357978-fb43-4a36-b26e-6262b3973c10 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:33.407965 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-a0357978-fb43-4a36-b26e-6262b3973c10 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: d360de38-a762-403b-bed3-d9ac43ffa09d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:33.414475 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a0357978-fb43-4a36-b26e-6262b3973c10 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:33.414928 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a0357978-fb43-4a36-b26e-6262b3973c10 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:33.415683 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a0357978-fb43-4a36-b26e-6262b3973c10 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:33.416116 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a0357978-fb43-4a36-b26e-6262b3973c10 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:33.489224 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a0357978-fb43-4a36-b26e-6262b3973c10 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:33.498633 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-a0357978-fb43-4a36-b26e-6262b3973c10 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d" status: 200 len: 1135 microversion: 2.1 time: 0.094175 Jul 12 17:47:33.498633 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 512/1020] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:33 2022] GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d => generated 1135 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:33.829535 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-ccd141df-be8d-4708-86eb-c12e0286c8ac tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:33.830162 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-ccd141df-be8d-4708-86eb-c12e0286c8ac tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:33.843115 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ccd141df-be8d-4708-86eb-c12e0286c8ac tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:33.843580 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ccd141df-be8d-4708-86eb-c12e0286c8ac tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:33.844382 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ccd141df-be8d-4708-86eb-c12e0286c8ac tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:33.844828 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ccd141df-be8d-4708-86eb-c12e0286c8ac tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:33.984761 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ccd141df-be8d-4708-86eb-c12e0286c8ac tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:33.993064 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-ccd141df-be8d-4708-86eb-c12e0286c8ac tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1676 microversion: 2.1 time: 0.167399 Jul 12 17:47:33.993758 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 509/1021] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:33 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:34.515656 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-dd19a838-01bf-45db-b42f-77f08c788a45 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:34.516273 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-dd19a838-01bf-45db-b42f-77f08c788a45 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: d360de38-a762-403b-bed3-d9ac43ffa09d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:34.526752 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-dd19a838-01bf-45db-b42f-77f08c788a45 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:34.526752 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-dd19a838-01bf-45db-b42f-77f08c788a45 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:34.528389 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-dd19a838-01bf-45db-b42f-77f08c788a45 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:34.529022 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-dd19a838-01bf-45db-b42f-77f08c788a45 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:34.599310 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-dd19a838-01bf-45db-b42f-77f08c788a45 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:34.607139 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-dd19a838-01bf-45db-b42f-77f08c788a45 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d" status: 200 len: 1209 microversion: 2.1 time: 0.097179 Jul 12 17:47:34.612624 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 513/1022] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:34 2022] GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d => generated 1209 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:35.014240 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-7f5eed0c-df56-4cf4-99d6-2cad62f813f3 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:35.015873 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-7f5eed0c-df56-4cf4-99d6-2cad62f813f3 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:35.023593 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7f5eed0c-df56-4cf4-99d6-2cad62f813f3 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:35.024285 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7f5eed0c-df56-4cf4-99d6-2cad62f813f3 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:35.025309 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7f5eed0c-df56-4cf4-99d6-2cad62f813f3 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:35.025954 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7f5eed0c-df56-4cf4-99d6-2cad62f813f3 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:35.208452 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-7f5eed0c-df56-4cf4-99d6-2cad62f813f3 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:35.216882 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-7f5eed0c-df56-4cf4-99d6-2cad62f813f3 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1676 microversion: 2.1 time: 0.208881 Jul 12 17:47:35.217549 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 510/1023] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:35 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1676 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:35.625942 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-47935da5-d08b-4ea2-9a15-63292e76ee73 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:35.626594 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-47935da5-d08b-4ea2-9a15-63292e76ee73 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: d360de38-a762-403b-bed3-d9ac43ffa09d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:35.633996 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-47935da5-d08b-4ea2-9a15-63292e76ee73 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:35.634803 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-47935da5-d08b-4ea2-9a15-63292e76ee73 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:35.636079 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-47935da5-d08b-4ea2-9a15-63292e76ee73 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:35.637194 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-47935da5-d08b-4ea2-9a15-63292e76ee73 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:35.907174 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-47935da5-d08b-4ea2-9a15-63292e76ee73 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:35.914950 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-47935da5-d08b-4ea2-9a15-63292e76ee73 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d" status: 200 len: 1277 microversion: 2.1 time: 0.293134 Jul 12 17:47:35.915535 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 514/1024] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:35 2022] GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d => generated 1277 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:36.034596 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-33140e8f-865c-4a33-ad8f-ce5fd0ef0a02 req-e538fabe-a37b-4eb8-af73-67a0e8044287 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d360de38-a762-403b-bed3-d9ac43ffa09d", "tag": "2b3ccb8b-4fb9-4bed-b329-5b6bbfc9647b"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:47:36.043524 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-33140e8f-865c-4a33-ad8f-ce5fd0ef0a02 req-e538fabe-a37b-4eb8-af73-67a0e8044287 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:36.044235 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-33140e8f-865c-4a33-ad8f-ce5fd0ef0a02 req-e538fabe-a37b-4eb8-af73-67a0e8044287 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:36.064841 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-33140e8f-865c-4a33-ad8f-ce5fd0ef0a02 req-e538fabe-a37b-4eb8-af73-67a0e8044287 service nova] Creating event network-changed:2b3ccb8b-4fb9-4bed-b329-5b6bbfc9647b for instance d360de38-a762-403b-bed3-d9ac43ffa09d on hv-cinder-84875 Jul 12 17:47:36.070448 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-33140e8f-865c-4a33-ad8f-ce5fd0ef0a02 req-e538fabe-a37b-4eb8-af73-67a0e8044287 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039373 Jul 12 17:47:36.071116 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 511/1025] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:47:36.234688 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-24a4ae36-a66c-4e1c-9733-1d0ba6eb5e09 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:36.237841 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-24a4ae36-a66c-4e1c-9733-1d0ba6eb5e09 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:36.243418 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-24a4ae36-a66c-4e1c-9733-1d0ba6eb5e09 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:36.243700 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-24a4ae36-a66c-4e1c-9733-1d0ba6eb5e09 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:36.244487 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-24a4ae36-a66c-4e1c-9733-1d0ba6eb5e09 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:36.245071 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-24a4ae36-a66c-4e1c-9733-1d0ba6eb5e09 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:36.380229 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell0:SELECT=2 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:47:36.398669 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-24a4ae36-a66c-4e1c-9733-1d0ba6eb5e09 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:36.408330 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-24a4ae36-a66c-4e1c-9733-1d0ba6eb5e09 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1676 microversion: 2.1 time: 0.178173 Jul 12 17:47:36.409169 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 515/1026] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:36 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:36.933469 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-650a6950-82b7-4f16-9d9e-073101b3c661 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:36.934204 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-650a6950-82b7-4f16-9d9e-073101b3c661 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: d360de38-a762-403b-bed3-d9ac43ffa09d] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:36.941331 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-650a6950-82b7-4f16-9d9e-073101b3c661 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:36.941787 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-650a6950-82b7-4f16-9d9e-073101b3c661 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:36.942609 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-650a6950-82b7-4f16-9d9e-073101b3c661 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:36.943168 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-650a6950-82b7-4f16-9d9e-073101b3c661 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:37.280736 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-00ca546e-ffe8-4b3c-8e2e-b6332590db05 tempest-VolumesNegativeTest-413332094 tempest-VolumesNegativeTest-413332094-project] Action: 'create', calling method: .version_select at 0x7f47ac12e1f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-78487648", "metadata": {"Type": "work"}}} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:47:37.306492 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-00ca546e-ffe8-4b3c-8e2e-b6332590db05 tempest-VolumesNegativeTest-413332094 tempest-VolumesNegativeTest-413332094-project] Request method failure captured: Jul 12 17:47:37.306492 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 17:47:37.306492 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:47:37.306492 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:47:37.306492 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:47:37.306492 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 120 Jul 12 17:47:37.306492 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:47:37.306492 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:47:37.306492 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:47:37.306492 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:47:37.306492 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbO5xjLi0S5ti6B6OfAOD3roYRIspqpv8sGIh0eLbHXjd-V4qiu5eBiLFwyMWWUNWc8UiWIeUazUmbRv497dxiqU0P1E9Whf_NCg6pGXS-YqI_qxqyN29jMgFeQqeOtHZIPdwXSWNwmkOPSO0l9w3meZmeKNSS9GF1jkTc-6dXgYrtA Jul 12 17:47:37.306492 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:47:37.306492 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:47:37.306492 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:47:37.306492 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:47:37.306492 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:47:37.306492 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:47:37.306492 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: 06574e6e01a24509affb68857311b6f1 Jul 12 17:47:37.306492 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-VolumesNegativeTest-413332094 Jul 12 17:47:37.306492 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:47:37.306492 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:47:37.309077 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06574e6e01a24509affb68857311b6f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_06574e6e01a24509affb68857311b6f1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06574e6e01a24509affb68857311b6f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/06574e6e01a24509affb68857311b6f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:47:37.309077 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-VolumesNegativeTest-413332094 Jul 12 17:47:37.309077 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: 06574e6e01a24509affb68857311b6f1 Jul 12 17:47:37.309077 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-VolumesNegativeTest-413332094 Jul 12 17:47:37.309077 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-VolumesNegativeTest-413332094-project Jul 12 17:47:37.309077 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:47:37.309077 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:47:37.309077 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: a150dc5df85048a28450e7f7311fba0d Jul 12 17:47:37.309077 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-VolumesNegativeTest-413332094-project Jul 12 17:47:37.309077 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Jul 12 17:47:37.309077 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-78487648", "metadata": {"Type": "work"}}} Jul 12 17:47:37.309077 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: Jul 12 17:47:37.309077 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 17:47:37.310140 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-78487648', 'metadata': {'Type': 'work'}}}} Jul 12 17:47:37.310140 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:47:37.310140 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:37.310140 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 17:47:37.310140 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 17:47:37.310140 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 17:47:37.310140 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise error Jul 12 17:47:37.310140 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 12 17:47:37.310140 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.310140 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 12 17:47:37.310140 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 17:47:37.310140 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.310140 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 17:47:37.310140 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi '#$%' Jul 12 17:47:37.310140 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.310140 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:47:37.310140 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.310140 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:37.310140 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:47:37.310140 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:47:37.310140 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:47:37.310140 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:47:37.316342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 17:47:37.316342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 17:47:37.316342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:47:37.316342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:47:37.316342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 17:47:37.316342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 17:47:37.316342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 17:47:37.316342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 17:47:37.316342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 17:47:37.316342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 17:47:37.316342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 17:47:37.316342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.316342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:47:37.316342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.316342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:37.316342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:47:37.316342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:47:37.316342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 17:47:37.316342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 17:47:37.317774 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 17:47:37.317774 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.317774 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-00ca546e-ffe8-4b3c-8e2e-b6332590db05 tempest-VolumesNegativeTest-413332094 tempest-VolumesNegativeTest-413332094-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:47:37.317774 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-00ca546e-ffe8-4b3c-8e2e-b6332590db05 tempest-VolumesNegativeTest-413332094 tempest-VolumesNegativeTest-413332094-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.168430 Jul 12 17:47:37.317774 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 516/1027] 10.222.0.16 () {60 vars in 1155 bytes} [Tue Jul 12 17:47:37 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 171 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 12 17:47:37.325501 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ac44e32a-95fd-406e-a9ca-2b632cde369e tempest-VolumesNegativeTest-413332094 tempest-VolumesNegativeTest-413332094-project] Action: 'create', calling method: .version_select at 0x7f479fb86040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1053824069", "metadata": {"Type": "work"}}} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:47:37.328750 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-650a6950-82b7-4f16-9d9e-073101b3c661 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:37.330196 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ac44e32a-95fd-406e-a9ca-2b632cde369e tempest-VolumesNegativeTest-413332094 tempest-VolumesNegativeTest-413332094-project] Request method failure captured: Jul 12 17:47:37.330196 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 17:47:37.330196 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:47:37.330196 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:47:37.330196 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:47:37.330196 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 120 Jul 12 17:47:37.330196 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:47:37.330196 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:47:37.330196 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:47:37.330196 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:47:37.330196 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbO5xjLi0S5ti6B6OfAOD3roYRIspqpv8sGIh0eLbHXjd-V4qiu5eBiLFwyMWWUNWc8UiWIeUazUmbRv497dxiqU0P1E9Whf_NCg6pGXS-YqI_qxqyN29jMgFeQqeOtHZIPdwXSWNwmkOPSO0l9w3meZmeKNSS9GF1jkTc-6dXgYrtA Jul 12 17:47:37.330196 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:47:37.330196 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:47:37.330196 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:47:37.330196 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:47:37.330196 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:47:37.330196 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:47:37.330196 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: 06574e6e01a24509affb68857311b6f1 Jul 12 17:47:37.330196 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-VolumesNegativeTest-413332094 Jul 12 17:47:37.330196 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:47:37.330196 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:47:37.331910 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06574e6e01a24509affb68857311b6f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_06574e6e01a24509affb68857311b6f1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06574e6e01a24509affb68857311b6f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/06574e6e01a24509affb68857311b6f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:47:37.331910 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-VolumesNegativeTest-413332094 Jul 12 17:47:37.331910 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: 06574e6e01a24509affb68857311b6f1 Jul 12 17:47:37.331910 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-VolumesNegativeTest-413332094 Jul 12 17:47:37.331910 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-VolumesNegativeTest-413332094-project Jul 12 17:47:37.331910 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:47:37.331910 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:47:37.331910 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: a150dc5df85048a28450e7f7311fba0d Jul 12 17:47:37.331910 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-VolumesNegativeTest-413332094-project Jul 12 17:47:37.331910 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Jul 12 17:47:37.331910 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1053824069", "metadata": {"Type": "work"}}} Jul 12 17:47:37.331910 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: Jul 12 17:47:37.331910 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 17:47:37.332779 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1053824069', 'metadata': {'Type': 'work'}}}} Jul 12 17:47:37.332779 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:47:37.332779 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:37.332779 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 17:47:37.332779 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 17:47:37.332779 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 17:47:37.332779 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise error Jul 12 17:47:37.332779 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 12 17:47:37.332779 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.332779 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 12 17:47:37.332779 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 17:47:37.332779 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.332779 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 17:47:37.332779 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi '0' Jul 12 17:47:37.332779 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.332779 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:47:37.332779 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.332779 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:37.332779 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:47:37.332779 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:47:37.332779 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:47:37.332779 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:47:37.334565 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 17:47:37.334565 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 17:47:37.334565 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:47:37.334565 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:47:37.334565 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 17:47:37.334565 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 17:47:37.334565 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 17:47:37.334565 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 17:47:37.334565 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 17:47:37.334565 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 17:47:37.334565 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 17:47:37.334565 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.334565 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:47:37.334565 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.334565 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:37.334565 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:47:37.334565 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:47:37.334565 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 17:47:37.334565 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 17:47:37.335929 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 17:47:37.335929 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.336429 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-650a6950-82b7-4f16-9d9e-073101b3c661 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d" status: 200 len: 1265 microversion: 2.1 time: 0.407583 Jul 12 17:47:37.337149 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ac44e32a-95fd-406e-a9ca-2b632cde369e tempest-VolumesNegativeTest-413332094 tempest-VolumesNegativeTest-413332094-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:47:37.338562 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 512/1028] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:36 2022] GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d => generated 1265 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:37.346980 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-ac44e32a-95fd-406e-a9ca-2b632cde369e tempest-VolumesNegativeTest-413332094 tempest-VolumesNegativeTest-413332094-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.023506 Jul 12 17:47:37.346980 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 517/1029] 10.222.0.16 () {60 vars in 1155 bytes} [Tue Jul 12 17:47:37 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 12 17:47:37.357912 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b9fee80e-b993-40b7-897f-fc10e1ecaa0e tempest-VolumesNegativeTest-413332094 tempest-VolumesNegativeTest-413332094-project] Action: 'create', calling method: .version_select at 0x7f479febdc10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1551612635", "metadata": {"Type": "work"}}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:47:37.361288 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b9fee80e-b993-40b7-897f-fc10e1ecaa0e tempest-VolumesNegativeTest-413332094 tempest-VolumesNegativeTest-413332094-project] Request method failure captured: Jul 12 17:47:37.361288 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 17:47:37.361288 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept: application/json Jul 12 17:47:37.361288 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept-Encoding: identity Jul 12 17:47:37.361288 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Connection: close Jul 12 17:47:37.361288 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Length: 119 Jul 12 17:47:37.361288 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Type: application/json Jul 12 17:47:37.361288 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Host: 10.222.0.16 Jul 12 17:47:37.361288 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Openstack-System-Scope: None Jul 12 17:47:37.361288 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: User-Agent: python-urllib3/1.26.9 Jul 12 17:47:37.361288 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Auth-Token: gAAAAABizbO5xjLi0S5ti6B6OfAOD3roYRIspqpv8sGIh0eLbHXjd-V4qiu5eBiLFwyMWWUNWc8UiWIeUazUmbRv497dxiqU0P1E9Whf_NCg6pGXS-YqI_qxqyN29jMgFeQqeOtHZIPdwXSWNwmkOPSO0l9w3meZmeKNSS9GF1jkTc-6dXgYrtA Jul 12 17:47:37.361288 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Id: None Jul 12 17:47:37.361288 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Name: None Jul 12 17:47:37.361288 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Identity-Status: Confirmed Jul 12 17:47:37.361288 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Is-Admin-Project: True Jul 12 17:47:37.361288 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Id: default Jul 12 17:47:37.361288 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Name: Default Jul 12 17:47:37.361288 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Id: 06574e6e01a24509affb68857311b6f1 Jul 12 17:47:37.361288 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Name: tempest-VolumesNegativeTest-413332094 Jul 12 17:47:37.361288 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Role: reader,member Jul 12 17:47:37.361288 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Roles: reader,member Jul 12 17:47:37.362986 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06574e6e01a24509affb68857311b6f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_06574e6e01a24509affb68857311b6f1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06574e6e01a24509affb68857311b6f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/06574e6e01a24509affb68857311b6f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:47:37.362986 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant: tempest-VolumesNegativeTest-413332094 Jul 12 17:47:37.362986 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Id: 06574e6e01a24509affb68857311b6f1 Jul 12 17:47:37.362986 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Name: tempest-VolumesNegativeTest-413332094 Jul 12 17:47:37.362986 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User: tempest-VolumesNegativeTest-413332094-project Jul 12 17:47:37.362986 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Id: default Jul 12 17:47:37.362986 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Name: Default Jul 12 17:47:37.362986 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Id: a150dc5df85048a28450e7f7311fba0d Jul 12 17:47:37.362986 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Name: tempest-VolumesNegativeTest-413332094-project Jul 12 17:47:37.362986 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Jul 12 17:47:37.362986 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1551612635", "metadata": {"Type": "work"}}} Jul 12 17:47:37.362986 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: method: Jul 12 17:47:37.362986 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 17:47:37.364210 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1551612635', 'metadata': {'Type': 'work'}}}} Jul 12 17:47:37.364210 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:47:37.364210 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:37.364210 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 17:47:37.364210 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 17:47:37.364210 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 17:47:37.364210 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise error Jul 12 17:47:37.364210 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 12 17:47:37.364210 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.364210 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 12 17:47:37.364210 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 17:47:37.364210 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.364210 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 17:47:37.364210 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi '' Jul 12 17:47:37.364210 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.364210 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:47:37.364210 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.364210 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:37.364210 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:47:37.364210 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:47:37.364210 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:47:37.364210 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:47:37.365794 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 17:47:37.365794 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 17:47:37.365794 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:47:37.365794 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:47:37.365794 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 17:47:37.365794 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 17:47:37.365794 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 17:47:37.365794 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 17:47:37.365794 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 17:47:37.365794 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 17:47:37.365794 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 17:47:37.365794 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.365794 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:47:37.365794 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.365794 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:37.365794 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:47:37.365794 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:47:37.365794 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 17:47:37.365794 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 17:47:37.367205 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 17:47:37.367205 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.367205 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b9fee80e-b993-40b7-897f-fc10e1ecaa0e tempest-VolumesNegativeTest-413332094 tempest-VolumesNegativeTest-413332094-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=130058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:47:37.367205 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-b9fee80e-b993-40b7-897f-fc10e1ecaa0e tempest-VolumesNegativeTest-413332094 tempest-VolumesNegativeTest-413332094-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009084 Jul 12 17:47:37.367205 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 513/1030] 10.222.0.16 () {60 vars in 1155 bytes} [Tue Jul 12 17:47:37 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 17:47:37.373934 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-51e19ae4-4094-47f3-b928-e8449a8c1e94 tempest-VolumesNegativeTest-413332094 tempest-VolumesNegativeTest-413332094-project] Calling method '.version_select at 0x7f479fb86040>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:37.401964 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-51e19ae4-4094-47f3-b928-e8449a8c1e94 tempest-VolumesNegativeTest-413332094 tempest-VolumesNegativeTest-413332094-project] HTTP exception thrown: Volume tempest-invalid-1035915069 could not be found. Jul 12 17:47:37.404024 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-51e19ae4-4094-47f3-b928-e8449a8c1e94 tempest-VolumesNegativeTest-413332094 tempest-VolumesNegativeTest-413332094-project] Request method failure captured: Jul 12 17:47:37.404024 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1035915069 HTTP/1.1 Jul 12 17:47:37.404024 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:47:37.404024 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:47:37.404024 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:47:37.404024 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 0 Jul 12 17:47:37.404024 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:47:37.404024 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:47:37.404024 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:47:37.404024 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:47:37.404024 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbO5xjLi0S5ti6B6OfAOD3roYRIspqpv8sGIh0eLbHXjd-V4qiu5eBiLFwyMWWUNWc8UiWIeUazUmbRv497dxiqU0P1E9Whf_NCg6pGXS-YqI_qxqyN29jMgFeQqeOtHZIPdwXSWNwmkOPSO0l9w3meZmeKNSS9GF1jkTc-6dXgYrtA Jul 12 17:47:37.404024 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:47:37.404024 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:47:37.404024 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:47:37.404024 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:47:37.404024 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:47:37.404024 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:47:37.404024 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: 06574e6e01a24509affb68857311b6f1 Jul 12 17:47:37.404024 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-VolumesNegativeTest-413332094 Jul 12 17:47:37.404024 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:47:37.404024 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:47:37.405723 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06574e6e01a24509affb68857311b6f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_06574e6e01a24509affb68857311b6f1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06574e6e01a24509affb68857311b6f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/06574e6e01a24509affb68857311b6f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:47:37.405723 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-VolumesNegativeTest-413332094 Jul 12 17:47:37.405723 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: 06574e6e01a24509affb68857311b6f1 Jul 12 17:47:37.405723 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-VolumesNegativeTest-413332094 Jul 12 17:47:37.405723 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-VolumesNegativeTest-413332094-project Jul 12 17:47:37.405723 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:47:37.405723 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:47:37.405723 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: a150dc5df85048a28450e7f7311fba0d Jul 12 17:47:37.405723 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-VolumesNegativeTest-413332094-project Jul 12 17:47:37.405723 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: Jul 12 17:47:37.405723 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Volume tempest-invalid-1035915069 could not be found. Jul 12 17:47:37.405723 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'id': 'tempest-invalid-1035915069'} Jul 12 17:47:37.405723 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:47:37.406726 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:37.406726 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 17:47:37.406726 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 17:47:37.406726 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 17:47:37.406726 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 17:47:37.406726 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 17:47:37.406726 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 17:47:37.406726 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 17:47:37.406726 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 17:47:37.406726 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 17:47:37.406726 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 17:47:37.406726 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 17:47:37.406726 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 17:47:37.406726 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 17:47:37.406726 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 17:47:37.406726 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1035915069 could not be found. (HTTP 404) (Request-ID: req-0da2a0a6-edab-489e-b599-d197df7d736c) Jul 12 17:47:37.406726 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.406726 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:47:37.406726 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.408213 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:37.408213 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 17:47:37.408213 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 17:47:37.408213 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 17:47:37.408213 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 17:47:37.408213 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 17:47:37.408213 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 17:47:37.408213 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 17:47:37.408213 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 17:47:37.408213 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 17:47:37.408213 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 17:47:37.408213 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 17:47:37.408213 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 17:47:37.408213 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 17:47:37.408213 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 17:47:37.408213 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 17:47:37.408213 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 17:47:37.408213 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 17:47:37.408213 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 17:47:37.409635 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 17:47:37.409635 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 17:47:37.409635 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 17:47:37.409635 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 17:47:37.409635 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1035915069 could not be found. Jul 12 17:47:37.409635 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.409635 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:47:37.409635 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.409635 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:37.409635 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:47:37.409635 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:47:37.409635 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:47:37.409635 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:47:37.409635 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 17:47:37.409635 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 17:47:37.409635 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:47:37.409635 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:47:37.409635 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 17:47:37.409635 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:47:37.409635 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1035915069 could not be found. Jul 12 17:47:37.411422 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.411422 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:47:37.411422 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.411422 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:37.411422 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:47:37.411422 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:47:37.411422 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:47:37.411422 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:47:37.411422 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1035915069 could not be found. Jul 12 17:47:37.411422 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.411422 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-51e19ae4-4094-47f3-b928-e8449a8c1e94 tempest-VolumesNegativeTest-413332094 tempest-VolumesNegativeTest-413332094-project] Returning 404 to user: Volume tempest-invalid-1035915069 could not be found. {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:47:37.411422 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-51e19ae4-4094-47f3-b928-e8449a8c1e94 tempest-VolumesNegativeTest-413332094 tempest-VolumesNegativeTest-413332094-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1035915069" status: 404 len: 99 microversion: 2.1 time: 0.036716 Jul 12 17:47:37.411422 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 518/1031] 10.222.0.16 () {58 vars in 1217 bytes} [Tue Jul 12 17:47:37 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1035915069 => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 12 17:47:37.415056 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-c392582f-9840-4309-8042-f37a0a6a3f19 tempest-VolumesNegativeTest-413332094 tempest-VolumesNegativeTest-413332094-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003847 Jul 12 17:47:37.415581 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 514/1032] 10.222.0.16 () {58 vars in 1139 bytes} [Tue Jul 12 17:47:37 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 12 17:47:37.425793 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-937e6174-e9fd-4096-b767-50f3bb366137 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:37.426397 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-937e6174-e9fd-4096-b767-50f3bb366137 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:37.426709 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-f2938e2c-de36-4d4f-b528-bc918ef60f73 tempest-VolumesNegativeTest-413332094 tempest-VolumesNegativeTest-413332094-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004247 Jul 12 17:47:37.427094 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 519/1033] 10.222.0.16 () {58 vars in 1136 bytes} [Tue Jul 12 17:47:37 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 12 17:47:37.434376 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-937e6174-e9fd-4096-b767-50f3bb366137 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:37.435529 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-937e6174-e9fd-4096-b767-50f3bb366137 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:37.436325 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-937e6174-e9fd-4096-b767-50f3bb366137 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:37.436768 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-937e6174-e9fd-4096-b767-50f3bb366137 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:37.436900 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-d45317c5-8368-4ff4-a769-3bcaba2bebee tempest-VolumesNegativeTest-413332094 tempest-VolumesNegativeTest-413332094-project] Calling method '.version_select at 0x7f479fce9280>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:37.466706 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-d45317c5-8368-4ff4-a769-3bcaba2bebee tempest-VolumesNegativeTest-413332094 tempest-VolumesNegativeTest-413332094-project] HTTP exception thrown: Volume 35e1259e-b26f-400e-a49c-04cf95369bf7 could not be found. Jul 12 17:47:37.468891 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-d45317c5-8368-4ff4-a769-3bcaba2bebee tempest-VolumesNegativeTest-413332094 tempest-VolumesNegativeTest-413332094-project] Request method failure captured: Jul 12 17:47:37.468891 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: DELETE /compute/v2.1/os-volumes/35e1259e-b26f-400e-a49c-04cf95369bf7 HTTP/1.1 Jul 12 17:47:37.468891 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:47:37.468891 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:47:37.468891 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:47:37.468891 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 0 Jul 12 17:47:37.468891 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:47:37.468891 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:47:37.468891 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:47:37.468891 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:47:37.468891 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbO5xjLi0S5ti6B6OfAOD3roYRIspqpv8sGIh0eLbHXjd-V4qiu5eBiLFwyMWWUNWc8UiWIeUazUmbRv497dxiqU0P1E9Whf_NCg6pGXS-YqI_qxqyN29jMgFeQqeOtHZIPdwXSWNwmkOPSO0l9w3meZmeKNSS9GF1jkTc-6dXgYrtA Jul 12 17:47:37.468891 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:47:37.468891 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:47:37.468891 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:47:37.468891 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:47:37.468891 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:47:37.468891 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:47:37.468891 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: 06574e6e01a24509affb68857311b6f1 Jul 12 17:47:37.468891 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-VolumesNegativeTest-413332094 Jul 12 17:47:37.468891 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:47:37.468891 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:47:37.470312 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06574e6e01a24509affb68857311b6f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_06574e6e01a24509affb68857311b6f1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06574e6e01a24509affb68857311b6f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/06574e6e01a24509affb68857311b6f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:47:37.470312 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-VolumesNegativeTest-413332094 Jul 12 17:47:37.470312 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: 06574e6e01a24509affb68857311b6f1 Jul 12 17:47:37.470312 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-VolumesNegativeTest-413332094 Jul 12 17:47:37.470312 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-VolumesNegativeTest-413332094-project Jul 12 17:47:37.470312 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:47:37.470312 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:47:37.470312 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: a150dc5df85048a28450e7f7311fba0d Jul 12 17:47:37.470312 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-VolumesNegativeTest-413332094-project Jul 12 17:47:37.470312 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: Jul 12 17:47:37.470312 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Volume 35e1259e-b26f-400e-a49c-04cf95369bf7 could not be found. Jul 12 17:47:37.470312 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'id': '35e1259e-b26f-400e-a49c-04cf95369bf7'} Jul 12 17:47:37.470312 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:47:37.471331 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:37.471331 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 17:47:37.471331 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 17:47:37.471331 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 17:47:37.471331 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 17:47:37.471331 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 17:47:37.471331 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 17:47:37.471331 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 17:47:37.471331 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 17:47:37.471331 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 17:47:37.471331 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 17:47:37.471331 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 17:47:37.471331 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 17:47:37.471331 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 17:47:37.471331 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 17:47:37.471331 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 35e1259e-b26f-400e-a49c-04cf95369bf7 could not be found. (HTTP 404) (Request-ID: req-485db10c-53a2-4b06-94c6-77674a730998) Jul 12 17:47:37.471331 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.471331 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:47:37.471331 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.473026 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:37.473026 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 17:47:37.473026 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 17:47:37.473026 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 17:47:37.473026 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 17:47:37.473026 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 17:47:37.473026 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 17:47:37.473026 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 17:47:37.473026 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 17:47:37.473026 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 17:47:37.473026 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 17:47:37.473026 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 17:47:37.473026 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 17:47:37.473026 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 17:47:37.473026 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 17:47:37.473026 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 17:47:37.473026 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 17:47:37.473026 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 17:47:37.473026 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 17:47:37.474464 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 17:47:37.474464 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 17:47:37.474464 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 17:47:37.474464 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 17:47:37.474464 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 35e1259e-b26f-400e-a49c-04cf95369bf7 could not be found. Jul 12 17:47:37.474464 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.474464 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:47:37.474464 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.474464 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:37.474464 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:47:37.474464 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:47:37.474464 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:47:37.474464 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:47:37.474464 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 17:47:37.474464 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 17:47:37.474464 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:47:37.474464 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:47:37.474464 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 17:47:37.474464 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:47:37.476130 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 35e1259e-b26f-400e-a49c-04cf95369bf7 could not be found. Jul 12 17:47:37.476130 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.476130 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:47:37.476130 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.476130 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:37.476130 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:47:37.476130 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:47:37.476130 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:47:37.476130 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:47:37.476130 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 35e1259e-b26f-400e-a49c-04cf95369bf7 could not be found. Jul 12 17:47:37.476130 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.476130 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-d45317c5-8368-4ff4-a769-3bcaba2bebee tempest-VolumesNegativeTest-413332094 tempest-VolumesNegativeTest-413332094-project] Returning 404 to user: Volume 35e1259e-b26f-400e-a49c-04cf95369bf7 could not be found. {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:47:37.476130 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-d45317c5-8368-4ff4-a769-3bcaba2bebee tempest-VolumesNegativeTest-413332094 tempest-VolumesNegativeTest-413332094-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/35e1259e-b26f-400e-a49c-04cf95369bf7" status: 404 len: 109 microversion: 2.1 time: 0.037994 Jul 12 17:47:37.476130 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 520/1034] 10.222.0.16 () {58 vars in 1247 bytes} [Tue Jul 12 17:47:37 2022] DELETE /compute/v2.1/os-volumes/35e1259e-b26f-400e-a49c-04cf95369bf7 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 17:47:37.481405 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-507098d3-d823-4b24-ab0b-d949523fe618 tempest-VolumesNegativeTest-413332094 tempest-VolumesNegativeTest-413332094-project] Calling method '.version_select at 0x7f479fce9c10>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:37.509924 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-507098d3-d823-4b24-ab0b-d949523fe618 tempest-VolumesNegativeTest-413332094 tempest-VolumesNegativeTest-413332094-project] HTTP exception thrown: Volume fcc70e47-1386-4848-a728-021fda9c1c3c could not be found. Jul 12 17:47:37.512047 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-507098d3-d823-4b24-ab0b-d949523fe618 tempest-VolumesNegativeTest-413332094 tempest-VolumesNegativeTest-413332094-project] Request method failure captured: Jul 12 17:47:37.512047 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: GET /compute/v2.1/os-volumes/fcc70e47-1386-4848-a728-021fda9c1c3c HTTP/1.1 Jul 12 17:47:37.512047 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:47:37.512047 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:47:37.512047 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:47:37.512047 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 0 Jul 12 17:47:37.512047 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:47:37.512047 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:47:37.512047 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:47:37.512047 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:47:37.512047 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbO5xjLi0S5ti6B6OfAOD3roYRIspqpv8sGIh0eLbHXjd-V4qiu5eBiLFwyMWWUNWc8UiWIeUazUmbRv497dxiqU0P1E9Whf_NCg6pGXS-YqI_qxqyN29jMgFeQqeOtHZIPdwXSWNwmkOPSO0l9w3meZmeKNSS9GF1jkTc-6dXgYrtA Jul 12 17:47:37.512047 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:47:37.512047 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:47:37.512047 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:47:37.512047 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:47:37.512047 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:47:37.512047 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:47:37.512047 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: 06574e6e01a24509affb68857311b6f1 Jul 12 17:47:37.512047 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-VolumesNegativeTest-413332094 Jul 12 17:47:37.512047 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:47:37.512047 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:47:37.513682 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06574e6e01a24509affb68857311b6f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_06574e6e01a24509affb68857311b6f1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06574e6e01a24509affb68857311b6f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/06574e6e01a24509affb68857311b6f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:47:37.513682 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-VolumesNegativeTest-413332094 Jul 12 17:47:37.513682 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: 06574e6e01a24509affb68857311b6f1 Jul 12 17:47:37.513682 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-VolumesNegativeTest-413332094 Jul 12 17:47:37.513682 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-VolumesNegativeTest-413332094-project Jul 12 17:47:37.513682 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:47:37.513682 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:47:37.513682 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: a150dc5df85048a28450e7f7311fba0d Jul 12 17:47:37.513682 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-VolumesNegativeTest-413332094-project Jul 12 17:47:37.513682 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: Jul 12 17:47:37.513682 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Volume fcc70e47-1386-4848-a728-021fda9c1c3c could not be found. Jul 12 17:47:37.513682 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'id': 'fcc70e47-1386-4848-a728-021fda9c1c3c'} Jul 12 17:47:37.513682 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:47:37.514718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:37.514718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 17:47:37.514718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 17:47:37.514718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 17:47:37.514718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 17:47:37.514718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 17:47:37.514718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 17:47:37.514718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 17:47:37.514718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 17:47:37.514718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 17:47:37.514718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 17:47:37.514718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 17:47:37.514718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 17:47:37.514718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 17:47:37.514718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 17:47:37.514718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fcc70e47-1386-4848-a728-021fda9c1c3c could not be found. (HTTP 404) (Request-ID: req-ba89a1e5-5d16-4196-a2c8-267ee375b66a) Jul 12 17:47:37.514718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.514718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:47:37.514718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.516342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:37.516342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 17:47:37.516342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 17:47:37.516342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 17:47:37.516342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 17:47:37.516342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 17:47:37.516342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 17:47:37.516342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 17:47:37.516342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 17:47:37.516342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 17:47:37.516342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 17:47:37.516342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 17:47:37.516342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 17:47:37.516342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 17:47:37.516342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 17:47:37.516342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 17:47:37.516342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 17:47:37.516342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 17:47:37.516342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 17:47:37.517709 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 17:47:37.517709 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 17:47:37.517709 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 17:47:37.517709 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 17:47:37.517709 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fcc70e47-1386-4848-a728-021fda9c1c3c could not be found. Jul 12 17:47:37.517709 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.517709 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:47:37.517709 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.517709 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:37.517709 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:47:37.517709 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:47:37.517709 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:47:37.517709 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:47:37.517709 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 17:47:37.517709 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 17:47:37.517709 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:47:37.517709 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:47:37.517709 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 17:47:37.517709 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:47:37.519275 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fcc70e47-1386-4848-a728-021fda9c1c3c could not be found. Jul 12 17:47:37.519275 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.519275 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:47:37.519275 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.519275 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:47:37.519275 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:47:37.519275 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:47:37.519275 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:47:37.519275 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:47:37.519275 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fcc70e47-1386-4848-a728-021fda9c1c3c could not be found. Jul 12 17:47:37.519275 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:47:37.519275 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-507098d3-d823-4b24-ab0b-d949523fe618 tempest-VolumesNegativeTest-413332094 tempest-VolumesNegativeTest-413332094-project] Returning 404 to user: Volume fcc70e47-1386-4848-a728-021fda9c1c3c could not be found. {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:47:37.519275 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-507098d3-d823-4b24-ab0b-d949523fe618 tempest-VolumesNegativeTest-413332094 tempest-VolumesNegativeTest-413332094-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/fcc70e47-1386-4848-a728-021fda9c1c3c" status: 404 len: 109 microversion: 2.1 time: 0.037042 Jul 12 17:47:37.519275 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 521/1035] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jul 12 17:47:37 2022] GET /compute/v2.1/os-volumes/fcc70e47-1386-4848-a728-021fda9c1c3c => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:47:37.590548 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-937e6174-e9fd-4096-b767-50f3bb366137 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:37.598245 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-937e6174-e9fd-4096-b767-50f3bb366137 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1653 microversion: 2.1 time: 0.176009 Jul 12 17:47:37.598847 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 515/1036] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:37 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1653 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:47:37.616963 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-90b2b207-eadb-4cd1-96ee-d1d36f2f35c6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:47:37.629015 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-90b2b207-eadb-4cd1-96ee-d1d36f2f35c6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:37.629469 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-90b2b207-eadb-4cd1-96ee-d1d36f2f35c6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:37.652690 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-90b2b207-eadb-4cd1-96ee-d1d36f2f35c6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Going to try to start instance {{(pid=130059) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 12 17:47:37.920716 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-90b2b207-eadb-4cd1-96ee-d1d36f2f35c6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "POST /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8/action" status: 202 len: 0 microversion: 2.1 time: 0.307384 Jul 12 17:47:37.924300 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 522/1037] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jul 12 17:47:37 2022] POST /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:47:37.931242 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-a96edeaf-1f97-49bd-a861-3be88e37f075 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:37.931892 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-a96edeaf-1f97-49bd-a861-3be88e37f075 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:37.938718 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a96edeaf-1f97-49bd-a861-3be88e37f075 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:37.939175 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a96edeaf-1f97-49bd-a861-3be88e37f075 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:37.939954 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a96edeaf-1f97-49bd-a861-3be88e37f075 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:37.940395 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a96edeaf-1f97-49bd-a861-3be88e37f075 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:38.088574 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-a96edeaf-1f97-49bd-a861-3be88e37f075 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:38.096684 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-a96edeaf-1f97-49bd-a861-3be88e37f075 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1662 microversion: 2.1 time: 0.169178 Jul 12 17:47:38.097410 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 516/1038] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:37 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1662 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:38.361075 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-d68a3d33-504e-494b-91a2-cdf619ca5843 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:38.361786 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-d68a3d33-504e-494b-91a2-cdf619ca5843 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: d360de38-a762-403b-bed3-d9ac43ffa09d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:38.368141 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d68a3d33-504e-494b-91a2-cdf619ca5843 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:38.368598 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d68a3d33-504e-494b-91a2-cdf619ca5843 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:38.369582 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d68a3d33-504e-494b-91a2-cdf619ca5843 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:38.370022 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d68a3d33-504e-494b-91a2-cdf619ca5843 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:38.550782 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-d68a3d33-504e-494b-91a2-cdf619ca5843 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:38.559053 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-d68a3d33-504e-494b-91a2-cdf619ca5843 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d" status: 200 len: 1265 microversion: 2.1 time: 0.202567 Jul 12 17:47:38.564564 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 523/1039] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:38 2022] GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:39.113696 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-261eaaa2-83ea-4683-9530-f9e14d22b650 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:39.114523 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-261eaaa2-83ea-4683-9530-f9e14d22b650 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:39.122642 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-261eaaa2-83ea-4683-9530-f9e14d22b650 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:39.123218 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-261eaaa2-83ea-4683-9530-f9e14d22b650 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:39.124004 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-261eaaa2-83ea-4683-9530-f9e14d22b650 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:39.124440 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-261eaaa2-83ea-4683-9530-f9e14d22b650 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:39.277449 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-261eaaa2-83ea-4683-9530-f9e14d22b650 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:39.284920 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-261eaaa2-83ea-4683-9530-f9e14d22b650 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1662 microversion: 2.1 time: 0.174429 Jul 12 17:47:39.286278 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 517/1040] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:39 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1662 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:39.580467 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ef674f9a-795e-4e21-bc05-0a14eaa22b06 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:39.581159 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-ef674f9a-795e-4e21-bc05-0a14eaa22b06 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: d360de38-a762-403b-bed3-d9ac43ffa09d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:39.587683 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ef674f9a-795e-4e21-bc05-0a14eaa22b06 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:39.588133 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ef674f9a-795e-4e21-bc05-0a14eaa22b06 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:39.588903 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ef674f9a-795e-4e21-bc05-0a14eaa22b06 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:39.590015 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ef674f9a-795e-4e21-bc05-0a14eaa22b06 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:39.744008 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-ef674f9a-795e-4e21-bc05-0a14eaa22b06 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:39.753456 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-ef674f9a-795e-4e21-bc05-0a14eaa22b06 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d" status: 200 len: 1265 microversion: 2.1 time: 0.176896 Jul 12 17:47:39.754028 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 524/1041] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:39 2022] GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:40.302608 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-33bd7863-f025-46c5-b455-1712fc858fe5 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:40.303227 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-33bd7863-f025-46c5-b455-1712fc858fe5 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:40.305650 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell0:SELECT=4 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:47:40.312557 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-33bd7863-f025-46c5-b455-1712fc858fe5 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:40.315650 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-33bd7863-f025-46c5-b455-1712fc858fe5 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:40.315650 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-33bd7863-f025-46c5-b455-1712fc858fe5 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:40.315650 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-33bd7863-f025-46c5-b455-1712fc858fe5 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:40.446353 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-33bd7863-f025-46c5-b455-1712fc858fe5 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:40.454974 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-33bd7863-f025-46c5-b455-1712fc858fe5 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1666 microversion: 2.1 time: 0.156170 Jul 12 17:47:40.455550 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 518/1042] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:40 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1666 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:40.782486 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-7276f376-4b05-493a-982f-ba46253ba823 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:40.783109 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-7276f376-4b05-493a-982f-ba46253ba823 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: d360de38-a762-403b-bed3-d9ac43ffa09d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:40.789901 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7276f376-4b05-493a-982f-ba46253ba823 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:40.790364 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7276f376-4b05-493a-982f-ba46253ba823 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:40.791341 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7276f376-4b05-493a-982f-ba46253ba823 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:40.791965 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7276f376-4b05-493a-982f-ba46253ba823 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:40.941881 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-7276f376-4b05-493a-982f-ba46253ba823 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:40.950781 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-7276f376-4b05-493a-982f-ba46253ba823 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d" status: 200 len: 1265 microversion: 2.1 time: 0.182724 Jul 12 17:47:40.951358 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 525/1043] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:40 2022] GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:41.967791 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-d14ee40c-1da0-4571-b611-147c0f24edbc tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:41.968432 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-d14ee40c-1da0-4571-b611-147c0f24edbc tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: d360de38-a762-403b-bed3-d9ac43ffa09d] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:41.975015 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d14ee40c-1da0-4571-b611-147c0f24edbc tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:41.975463 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d14ee40c-1da0-4571-b611-147c0f24edbc tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:41.976255 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d14ee40c-1da0-4571-b611-147c0f24edbc tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:41.976704 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d14ee40c-1da0-4571-b611-147c0f24edbc tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:42.115182 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-d14ee40c-1da0-4571-b611-147c0f24edbc tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:42.123662 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-d14ee40c-1da0-4571-b611-147c0f24edbc tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d" status: 200 len: 1265 microversion: 2.1 time: 0.160032 Jul 12 17:47:42.124238 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 519/1044] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:41 2022] GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:43.140838 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-1d3df763-63be-4a96-aee9-56120dbc7505 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:43.141455 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-1d3df763-63be-4a96-aee9-56120dbc7505 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: d360de38-a762-403b-bed3-d9ac43ffa09d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:43.143541 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell0:SELECT=10 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:47:43.149041 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1d3df763-63be-4a96-aee9-56120dbc7505 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:43.149498 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1d3df763-63be-4a96-aee9-56120dbc7505 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:43.150324 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1d3df763-63be-4a96-aee9-56120dbc7505 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:43.150797 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1d3df763-63be-4a96-aee9-56120dbc7505 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:43.286974 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-1d3df763-63be-4a96-aee9-56120dbc7505 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:43.295690 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-1d3df763-63be-4a96-aee9-56120dbc7505 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d" status: 200 len: 1265 microversion: 2.1 time: 0.158813 Jul 12 17:47:43.296274 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 526/1045] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:43 2022] GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:44.313131 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-9b438e58-8e22-48e7-9877-917277e0087c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:44.313828 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-9b438e58-8e22-48e7-9877-917277e0087c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: d360de38-a762-403b-bed3-d9ac43ffa09d] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:44.321085 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9b438e58-8e22-48e7-9877-917277e0087c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:44.323163 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9b438e58-8e22-48e7-9877-917277e0087c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:44.323163 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9b438e58-8e22-48e7-9877-917277e0087c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:44.323163 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9b438e58-8e22-48e7-9877-917277e0087c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:44.343960 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:47:44.542165 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-9b438e58-8e22-48e7-9877-917277e0087c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:44.551260 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-9b438e58-8e22-48e7-9877-917277e0087c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d" status: 200 len: 1265 microversion: 2.1 time: 0.242570 Jul 12 17:47:44.562640 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 520/1046] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:44 2022] GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:45.574871 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-d1e3858d-5c05-4037-a14e-5ea494a43346 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:45.575713 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-d1e3858d-5c05-4037-a14e-5ea494a43346 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: d360de38-a762-403b-bed3-d9ac43ffa09d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:45.586472 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d1e3858d-5c05-4037-a14e-5ea494a43346 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:45.587345 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d1e3858d-5c05-4037-a14e-5ea494a43346 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:45.588431 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d1e3858d-5c05-4037-a14e-5ea494a43346 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:45.588650 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d1e3858d-5c05-4037-a14e-5ea494a43346 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:45.795017 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-d1e3858d-5c05-4037-a14e-5ea494a43346 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:45.804217 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-d1e3858d-5c05-4037-a14e-5ea494a43346 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d" status: 200 len: 1265 microversion: 2.1 time: 0.234814 Jul 12 17:47:45.805270 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 527/1047] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:45 2022] GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:46.824421 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-bed7b8c6-f7bd-406c-9924-d040e4e357d9 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:46.825656 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-bed7b8c6-f7bd-406c-9924-d040e4e357d9 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: d360de38-a762-403b-bed3-d9ac43ffa09d] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:46.832172 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bed7b8c6-f7bd-406c-9924-d040e4e357d9 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:46.832633 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bed7b8c6-f7bd-406c-9924-d040e4e357d9 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:46.833409 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bed7b8c6-f7bd-406c-9924-d040e4e357d9 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:46.833979 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bed7b8c6-f7bd-406c-9924-d040e4e357d9 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:46.978610 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-bed7b8c6-f7bd-406c-9924-d040e4e357d9 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:46.986509 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-bed7b8c6-f7bd-406c-9924-d040e4e357d9 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d" status: 200 len: 1265 microversion: 2.1 time: 0.168720 Jul 12 17:47:46.989919 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 521/1048] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:46 2022] GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:47.256477 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-4fbf9052-2399-401e-b831-e7a4350bcdb4 req-a9bf7689-ba1c-460e-84b0-1a8b2b713643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d360de38-a762-403b-bed3-d9ac43ffa09d", "name": "network-vif-plugged", "status": "completed", "tag": "2b3ccb8b-4fb9-4bed-b329-5b6bbfc9647b"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:47:47.266453 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-4fbf9052-2399-401e-b831-e7a4350bcdb4 req-a9bf7689-ba1c-460e-84b0-1a8b2b713643 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:47.266916 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-4fbf9052-2399-401e-b831-e7a4350bcdb4 req-a9bf7689-ba1c-460e-84b0-1a8b2b713643 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:47.279377 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-4fbf9052-2399-401e-b831-e7a4350bcdb4 req-a9bf7689-ba1c-460e-84b0-1a8b2b713643 service nova] Creating event network-vif-plugged:2b3ccb8b-4fb9-4bed-b329-5b6bbfc9647b for instance d360de38-a762-403b-bed3-d9ac43ffa09d on hv-cinder-84875 Jul 12 17:47:47.285551 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-4fbf9052-2399-401e-b831-e7a4350bcdb4 req-a9bf7689-ba1c-460e-84b0-1a8b2b713643 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035964 Jul 12 17:47:47.286186 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 528/1049] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:47:48.003796 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-9b530d83-a2e1-45e0-9d61-2c75824b294c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:48.005035 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-9b530d83-a2e1-45e0-9d61-2c75824b294c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: d360de38-a762-403b-bed3-d9ac43ffa09d] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:48.007787 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_api:SELECT=43 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:47:48.014033 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9b530d83-a2e1-45e0-9d61-2c75824b294c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:48.014534 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9b530d83-a2e1-45e0-9d61-2c75824b294c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:48.015438 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9b530d83-a2e1-45e0-9d61-2c75824b294c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:48.015935 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9b530d83-a2e1-45e0-9d61-2c75824b294c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:48.162736 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-9b530d83-a2e1-45e0-9d61-2c75824b294c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:48.170568 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-9b530d83-a2e1-45e0-9d61-2c75824b294c tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d" status: 200 len: 1265 microversion: 2.1 time: 0.170980 Jul 12 17:47:48.171163 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 522/1050] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:47 2022] GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:49.187875 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a91570ad-5086-4684-992d-60a684480dbe tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:49.188569 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-a91570ad-5086-4684-992d-60a684480dbe tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: d360de38-a762-403b-bed3-d9ac43ffa09d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:49.199164 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a91570ad-5086-4684-992d-60a684480dbe tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:49.199164 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a91570ad-5086-4684-992d-60a684480dbe tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:49.199164 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a91570ad-5086-4684-992d-60a684480dbe tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:49.199164 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a91570ad-5086-4684-992d-60a684480dbe tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:49.335870 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a91570ad-5086-4684-992d-60a684480dbe tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:49.344216 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-a91570ad-5086-4684-992d-60a684480dbe tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d" status: 200 len: 1265 microversion: 2.1 time: 0.160502 Jul 12 17:47:49.344789 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 529/1051] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:49 2022] GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:50.361625 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-d7d7fac9-e16d-4f64-b155-d814f288001f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:50.362213 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-d7d7fac9-e16d-4f64-b155-d814f288001f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: d360de38-a762-403b-bed3-d9ac43ffa09d] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:50.368991 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d7d7fac9-e16d-4f64-b155-d814f288001f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:50.369441 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d7d7fac9-e16d-4f64-b155-d814f288001f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:50.370243 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d7d7fac9-e16d-4f64-b155-d814f288001f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:50.370704 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d7d7fac9-e16d-4f64-b155-d814f288001f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:50.510163 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-d7d7fac9-e16d-4f64-b155-d814f288001f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:50.518049 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-d7d7fac9-e16d-4f64-b155-d814f288001f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d" status: 200 len: 1265 microversion: 2.1 time: 0.160363 Jul 12 17:47:50.518655 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 523/1052] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:50 2022] GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:51.534944 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-65fd0a39-daea-4979-bd14-7560c51854e4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:51.535586 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-65fd0a39-daea-4979-bd14-7560c51854e4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: d360de38-a762-403b-bed3-d9ac43ffa09d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:51.542262 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-65fd0a39-daea-4979-bd14-7560c51854e4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:51.542743 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-65fd0a39-daea-4979-bd14-7560c51854e4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:51.543516 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-65fd0a39-daea-4979-bd14-7560c51854e4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:51.543960 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-65fd0a39-daea-4979-bd14-7560c51854e4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:51.677964 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-65fd0a39-daea-4979-bd14-7560c51854e4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:51.681599 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:47:51.686929 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-65fd0a39-daea-4979-bd14-7560c51854e4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d" status: 200 len: 1265 microversion: 2.1 time: 0.155810 Jul 12 17:47:51.687484 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 530/1053] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:51 2022] GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:52.705318 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-09927da8-c8a4-404b-8320-9e4760bb48d5 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:52.705935 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-09927da8-c8a4-404b-8320-9e4760bb48d5 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: d360de38-a762-403b-bed3-d9ac43ffa09d] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:52.715098 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-09927da8-c8a4-404b-8320-9e4760bb48d5 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:52.715098 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-09927da8-c8a4-404b-8320-9e4760bb48d5 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:52.715098 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-09927da8-c8a4-404b-8320-9e4760bb48d5 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:52.715526 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-09927da8-c8a4-404b-8320-9e4760bb48d5 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:52.862141 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-09927da8-c8a4-404b-8320-9e4760bb48d5 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:52.862907 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-09927da8-c8a4-404b-8320-9e4760bb48d5 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d" status: 200 len: 1452 microversion: 2.1 time: 0.162382 Jul 12 17:47:52.866497 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 524/1054] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:52 2022] GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:52.879747 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-e6909b92-0d6b-4cfd-8298-ce85aa132553 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:47:52.880369 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-e6909b92-0d6b-4cfd-8298-ce85aa132553 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: d360de38-a762-403b-bed3-d9ac43ffa09d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:47:52.888379 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e6909b92-0d6b-4cfd-8298-ce85aa132553 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:52.888834 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e6909b92-0d6b-4cfd-8298-ce85aa132553 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:52.889614 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e6909b92-0d6b-4cfd-8298-ce85aa132553 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:52.890066 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e6909b92-0d6b-4cfd-8298-ce85aa132553 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:53.032772 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-e6909b92-0d6b-4cfd-8298-ce85aa132553 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:47:53.041182 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-e6909b92-0d6b-4cfd-8298-ce85aa132553 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d" status: 200 len: 1452 microversion: 2.1 time: 0.165242 Jul 12 17:47:53.041756 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 531/1055] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:47:52 2022] GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:47:55.329451 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-2f8228e9-cccf-4d4c-a922-81f0be657b5e req-078ca7aa-183a-4a81-b156-025fa3f14f9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d360de38-a762-403b-bed3-d9ac43ffa09d", "tag": "2b3ccb8b-4fb9-4bed-b329-5b6bbfc9647b"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:47:55.338990 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-2f8228e9-cccf-4d4c-a922-81f0be657b5e req-078ca7aa-183a-4a81-b156-025fa3f14f9c service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:47:55.339505 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-2f8228e9-cccf-4d4c-a922-81f0be657b5e req-078ca7aa-183a-4a81-b156-025fa3f14f9c service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:47:55.351775 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-2f8228e9-cccf-4d4c-a922-81f0be657b5e req-078ca7aa-183a-4a81-b156-025fa3f14f9c service nova] Creating event network-changed:2b3ccb8b-4fb9-4bed-b329-5b6bbfc9647b for instance d360de38-a762-403b-bed3-d9ac43ffa09d on hv-cinder-84875 Jul 12 17:47:55.358336 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-2f8228e9-cccf-4d4c-a922-81f0be657b5e req-078ca7aa-183a-4a81-b156-025fa3f14f9c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032401 Jul 12 17:47:55.359444 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 525/1056] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:48:19.335186 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-89f81ec3-8978-43d1-a70e-6af20b211689 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:19.336112 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-89f81ec3-8978-43d1-a70e-6af20b211689 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:19.339675 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:48:19.344872 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-89f81ec3-8978-43d1-a70e-6af20b211689 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:19.348624 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-89f81ec3-8978-43d1-a70e-6af20b211689 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:19.348624 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-89f81ec3-8978-43d1-a70e-6af20b211689 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:19.348624 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-89f81ec3-8978-43d1-a70e-6af20b211689 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:19.377400 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-89f81ec3-8978-43d1-a70e-6af20b211689 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046170 Jul 12 17:48:19.377956 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 532/1057] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:48:19 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 17:48:19.434671 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_api:SELECT=7 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:48:19.435467 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=28 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:48:19.439756 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-9e1ebe13-4c25-440b-b28d-30669affe706 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:19.440358 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-9e1ebe13-4c25-440b-b28d-30669affe706 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:19.447453 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9e1ebe13-4c25-440b-b28d-30669affe706 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:19.447901 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9e1ebe13-4c25-440b-b28d-30669affe706 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:19.448661 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9e1ebe13-4c25-440b-b28d-30669affe706 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:19.449093 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-9e1ebe13-4c25-440b-b28d-30669affe706 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:19.475855 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-9e1ebe13-4c25-440b-b28d-30669affe706 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Going to try to terminate instance {{(pid=130058) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:48:19.789413 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-9e1ebe13-4c25-440b-b28d-30669affe706 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 204 len: 0 microversion: 2.1 time: 0.356099 Jul 12 17:48:19.790001 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 526/1058] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 12 17:48:19 2022] DELETE /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:48:19.798675 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-99999f75-1876-48ee-983e-f4c22c559e2c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:19.799283 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-99999f75-1876-48ee-983e-f4c22c559e2c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:19.806134 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-99999f75-1876-48ee-983e-f4c22c559e2c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:19.806635 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-99999f75-1876-48ee-983e-f4c22c559e2c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:19.807396 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-99999f75-1876-48ee-983e-f4c22c559e2c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:19.807825 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-99999f75-1876-48ee-983e-f4c22c559e2c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:19.941800 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-99999f75-1876-48ee-983e-f4c22c559e2c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:48:19.950127 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-99999f75-1876-48ee-983e-f4c22c559e2c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1672 microversion: 2.1 time: 0.155621 Jul 12 17:48:19.957197 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 533/1059] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:48:19 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:48:20.969468 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-95df631e-fd44-430c-8e1f-3df55254d21a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:20.970167 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-95df631e-fd44-430c-8e1f-3df55254d21a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:20.976816 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-95df631e-fd44-430c-8e1f-3df55254d21a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:20.977270 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-95df631e-fd44-430c-8e1f-3df55254d21a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:20.978034 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-95df631e-fd44-430c-8e1f-3df55254d21a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:20.978528 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-95df631e-fd44-430c-8e1f-3df55254d21a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:21.237579 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-95df631e-fd44-430c-8e1f-3df55254d21a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:48:21.246076 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-95df631e-fd44-430c-8e1f-3df55254d21a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1672 microversion: 2.1 time: 0.280872 Jul 12 17:48:21.246701 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 527/1060] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:48:20 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1672 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:48:22.268390 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-d33684df-2cfc-40f2-9bf4-a6c44df8ab54 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:22.269849 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-d33684df-2cfc-40f2-9bf4-a6c44df8ab54 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:22.278990 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d33684df-2cfc-40f2-9bf4-a6c44df8ab54 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:22.279848 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d33684df-2cfc-40f2-9bf4-a6c44df8ab54 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:22.280886 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d33684df-2cfc-40f2-9bf4-a6c44df8ab54 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:22.281536 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d33684df-2cfc-40f2-9bf4-a6c44df8ab54 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:22.452440 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-d33684df-2cfc-40f2-9bf4-a6c44df8ab54 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:48:22.461430 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-d33684df-2cfc-40f2-9bf4-a6c44df8ab54 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1672 microversion: 2.1 time: 0.201361 Jul 12 17:48:22.474798 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 534/1061] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:48:22 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1672 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:48:23.120125 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-ee3639e9-c344-40df-9930-0ab8a240c639 req-70e09ed8-a10e-4f27-b628-6fc82403f79a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8f7b428-9b6d-459f-8ad2-cab4f82052e8", "name": "network-vif-deleted", "tag": "4aa2bfdc-7ea3-4238-b47f-3803e818647e"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:48:23.128978 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-ee3639e9-c344-40df-9930-0ab8a240c639 req-70e09ed8-a10e-4f27-b628-6fc82403f79a service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:23.129914 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-ee3639e9-c344-40df-9930-0ab8a240c639 req-70e09ed8-a10e-4f27-b628-6fc82403f79a service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:23.142911 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-ee3639e9-c344-40df-9930-0ab8a240c639 req-70e09ed8-a10e-4f27-b628-6fc82403f79a service nova] Creating event network-vif-deleted:4aa2bfdc-7ea3-4238-b47f-3803e818647e for instance c8f7b428-9b6d-459f-8ad2-cab4f82052e8 on hv-cinder-84875 Jul 12 17:48:23.149907 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-ee3639e9-c344-40df-9930-0ab8a240c639 req-70e09ed8-a10e-4f27-b628-6fc82403f79a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033366 Jul 12 17:48:23.161761 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 528/1062] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:48:23.494266 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-e5ec037a-3343-4628-9603-919db22a33cc tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:23.494769 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-e5ec037a-3343-4628-9603-919db22a33cc tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:23.501887 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e5ec037a-3343-4628-9603-919db22a33cc tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:23.502729 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e5ec037a-3343-4628-9603-919db22a33cc tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:23.503775 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e5ec037a-3343-4628-9603-919db22a33cc tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:23.504220 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e5ec037a-3343-4628-9603-919db22a33cc tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:23.540102 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e5ec037a-3343-4628-9603-919db22a33cc tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:23.540709 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e5ec037a-3343-4628-9603-919db22a33cc tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:23.541357 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.objects.instance [None req-e5ec037a-3343-4628-9603-919db22a33cc tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lazy-loading 'fault' on Instance uuid c8f7b428-9b6d-459f-8ad2-cab4f82052e8 {{(pid=130059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:48:23.593497 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-e5ec037a-3343-4628-9603-919db22a33cc tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:48:23.602865 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-e5ec037a-3343-4628-9603-919db22a33cc tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 200 len: 1327 microversion: 2.1 time: 0.115625 Jul 12 17:48:23.604454 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 535/1063] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:48:23 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 1327 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:48:24.623343 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-2871a2e1-1977-4622-b2a6-7f13d24cab9e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:24.624189 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-2871a2e1-1977-4622-b2a6-7f13d24cab9e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:24.631188 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2871a2e1-1977-4622-b2a6-7f13d24cab9e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:24.631645 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2871a2e1-1977-4622-b2a6-7f13d24cab9e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:24.632528 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2871a2e1-1977-4622-b2a6-7f13d24cab9e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:24.632869 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2871a2e1-1977-4622-b2a6-7f13d24cab9e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:24.647283 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.wsgi [None req-2871a2e1-1977-4622-b2a6-7f13d24cab9e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] HTTP exception thrown: Instance c8f7b428-9b6d-459f-8ad2-cab4f82052e8 could not be found. Jul 12 17:48:24.649111 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-2871a2e1-1977-4622-b2a6-7f13d24cab9e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Request method failure captured: Jul 12 17:48:24.649111 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: request: GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 HTTP/1.1 Jul 12 17:48:24.649111 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept: application/json Jul 12 17:48:24.649111 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept-Encoding: identity Jul 12 17:48:24.649111 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Connection: close Jul 12 17:48:24.649111 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Length: 0 Jul 12 17:48:24.649111 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Type: application/json Jul 12 17:48:24.649111 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Host: 10.222.0.16 Jul 12 17:48:24.649111 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Openstack-System-Scope: None Jul 12 17:48:24.649111 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: User-Agent: python-urllib3/1.26.9 Jul 12 17:48:24.649111 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Auth-Token: gAAAAABizbMmt4YCwTUeC4XdvUZe4H27QldHz3HRAPXmXVkUeBDN7Bcjfm4m6bE-hW_zXJAaxHvCivgFt_WIiQMi1EBD4q7XQdv127t-mSWI9EhHju6oMUzqWKnGyGgi5-JVpl0yaf80XSahng2N9wh8GG30r8BRA1FWo2T8Wmyi1dTiZJ0KL9M Jul 12 17:48:24.649111 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Id: None Jul 12 17:48:24.649111 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Name: None Jul 12 17:48:24.649111 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Identity-Status: Confirmed Jul 12 17:48:24.649111 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Is-Admin-Project: True Jul 12 17:48:24.649111 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Id: default Jul 12 17:48:24.649111 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Name: Default Jul 12 17:48:24.649111 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Id: 041c2c26c82a44d98d2229969c1f3618 Jul 12 17:48:24.649111 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Name: tempest-AttachVolumeTestJSON-1823537430 Jul 12 17:48:24.649111 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Role: reader,member Jul 12 17:48:24.649111 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Roles: reader,member Jul 12 17:48:24.650710 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/041c2c26c82a44d98d2229969c1f3618"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_041c2c26c82a44d98d2229969c1f3618", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/041c2c26c82a44d98d2229969c1f3618"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/041c2c26c82a44d98d2229969c1f3618"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:48:24.650710 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant: tempest-AttachVolumeTestJSON-1823537430 Jul 12 17:48:24.650710 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Id: 041c2c26c82a44d98d2229969c1f3618 Jul 12 17:48:24.650710 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1823537430 Jul 12 17:48:24.650710 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User: tempest-AttachVolumeTestJSON-1823537430-project Jul 12 17:48:24.650710 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Id: default Jul 12 17:48:24.650710 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Name: Default Jul 12 17:48:24.650710 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Id: e3d86a1cde9f407cae8ac050fe000d47 Jul 12 17:48:24.650710 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Name: tempest-AttachVolumeTestJSON-1823537430-project Jul 12 17:48:24.650710 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: method: > Jul 12 17:48:24.650710 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: exception: Instance c8f7b428-9b6d-459f-8ad2-cab4f82052e8 could not be found. Jul 12 17:48:24.650710 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: action_args: {'id': 'c8f7b428-9b6d-459f-8ad2-cab4f82052e8'} Jul 12 17:48:24.651833 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:48:24.651833 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:48:24.651833 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:48:24.651833 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:48:24.651833 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:48:24.651833 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:48:24.651833 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:48:24.651833 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:48:24.651833 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:48:24.651833 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:48:24.651833 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8f7b428-9b6d-459f-8ad2-cab4f82052e8 could not be found. Jul 12 17:48:24.651833 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:48:24.651833 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:48:24.651833 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:48:24.651833 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:48:24.651833 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:48:24.651833 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:48:24.651833 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:48:24.651833 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:48:24.651833 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:48:24.653275 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:48:24.653275 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:48:24.653275 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:48:24.653275 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:48:24.653275 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:48:24.653275 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:48:24.653275 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:48:24.653275 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8f7b428-9b6d-459f-8ad2-cab4f82052e8 could not be found. Jul 12 17:48:24.653275 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:48:24.653275 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:48:24.653275 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:48:24.653275 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:48:24.653275 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:48:24.653275 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:48:24.653275 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:48:24.653275 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:48:24.653275 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8f7b428-9b6d-459f-8ad2-cab4f82052e8 could not be found. Jul 12 17:48:24.653275 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:48:24.655274 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-2871a2e1-1977-4622-b2a6-7f13d24cab9e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Returning 404 to user: Instance c8f7b428-9b6d-459f-8ad2-cab4f82052e8 could not be found. {{(pid=130058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:48:24.655274 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-2871a2e1-1977-4622-b2a6-7f13d24cab9e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 404 len: 111 microversion: 2.1 time: 0.031597 Jul 12 17:48:24.655274 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 529/1064] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:48:24 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:48:24.665377 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-093cd299-e7df-4dc3-8468-547bf721fb31 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '.version_select at 0x7f479fdcb280>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:24.781979 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-093cd299-e7df-4dc3-8468-547bf721fb31 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2084892738" status: 202 len: 0 microversion: 2.1 time: 0.123628 Jul 12 17:48:24.782088 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 536/1065] 10.222.0.16 () {58 vars in 1220 bytes} [Tue Jul 12 17:48:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2084892738 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:48:25.608165 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-fcb3d4b8-1edb-4b1a-bbc7-8ba1a4d90621 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Action: 'create', calling method: .version_select at 0x7f47ac1865e0>, body: {"keypair": {"name": "tempest-keypair-1984682139", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiH31nfxA8X3KszRXjxEU7nmtgamJdF8rWNKqBl+wG+jc6D+eE/Y3lbMQ6X39VP9asAvDY3/3mXGbDaL45CtoH8HuEqKn8Nh6mV/FByJo/nwRnfHFSpSMreRExLz8cFUw=="}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:48:25.623012 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-fcb3d4b8-1edb-4b1a-bbc7-8ba1a4d90621 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Getting quotas for project 041c2c26c82a44d98d2229969c1f3618. Resources: {'key_pairs'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:48:25.627685 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-fcb3d4b8-1edb-4b1a-bbc7-8ba1a4d90621 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Getting quotas for user e3d86a1cde9f407cae8ac050fe000d47 and project 041c2c26c82a44d98d2229969c1f3618. Resources: {'key_pairs'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:48:25.760465 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-fcb3d4b8-1edb-4b1a-bbc7-8ba1a4d90621 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.157374 Jul 12 17:48:25.761770 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 530/1066] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Jul 12 17:48:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:48:28.307984 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-0e082eb5-ab84-49dd-b0e4-0934cc9fd708 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1101880271", "imageRef": "cb077f42-97cd-41cf-8758-764c562534f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "54486e6f-4939-452b-9a54-f7e95a6dd84a"}], "security_groups": [{"name": "tempest-securitygroup--127285037"}], "key_name": "tempest-keypair-1984682139", "user_data": "}} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:48:28.418047 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.network.neutron [None req-0e082eb5-ab84-49dd-b0e4-0934cc9fd708 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] validate_networks() for [('54486e6f-4939-452b-9a54-f7e95a6dd84a', None, None, None, None, None)] {{(pid=130059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:48:28.814868 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-0e082eb5-ab84-49dd-b0e4-0934cc9fd708 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Flavor limits 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:48:28.816557 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-0e082eb5-ab84-49dd-b0e4-0934cc9fd708 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Image limits 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:48:28.816557 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-0e082eb5-ab84-49dd-b0e4-0934cc9fd708 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Flavor pref 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:48:28.816557 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-0e082eb5-ab84-49dd-b0e4-0934cc9fd708 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Image pref 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:48:28.816845 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-0e082eb5-ab84-49dd-b0e4-0934cc9fd708 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:48:28.827344 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0e082eb5-ab84-49dd-b0e4-0934cc9fd708 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:28.827799 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0e082eb5-ab84-49dd-b0e4-0934cc9fd708 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:28.828702 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0e082eb5-ab84-49dd-b0e4-0934cc9fd708 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:28.829129 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0e082eb5-ab84-49dd-b0e4-0934cc9fd708 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:28.847250 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.quota [None req-0e082eb5-ab84-49dd-b0e4-0934cc9fd708 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Getting quotas for project 041c2c26c82a44d98d2229969c1f3618. Resources: {'cores', 'instances', 'ram'} {{(pid=130059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:48:28.852656 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.quota [None req-0e082eb5-ab84-49dd-b0e4-0934cc9fd708 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Getting quotas for user e3d86a1cde9f407cae8ac050fe000d47 and project 041c2c26c82a44d98d2229969c1f3618. Resources: {'cores', 'instances', 'ram'} {{(pid=130059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:48:28.865180 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-0e082eb5-ab84-49dd-b0e4-0934cc9fd708 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Going to run 1 instances... {{(pid=130059) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:48:28.867550 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-0e082eb5-ab84-49dd-b0e4-0934cc9fd708 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb077f42-97cd-41cf-8758-764c562534f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:48:28.981781 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-0e082eb5-ab84-49dd-b0e4-0934cc9fd708 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.678764 Jul 12 17:48:28.982825 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 537/1067] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 12 17:48:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:48:28.993187 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-8f24ce5f-72b1-4b3f-aaaa-dc8bd607dda6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:28.993893 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-8f24ce5f-72b1-4b3f-aaaa-dc8bd607dda6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:29.055907 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-8f24ce5f-72b1-4b3f-aaaa-dc8bd607dda6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:48:29.062850 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-8f24ce5f-72b1-4b3f-aaaa-dc8bd607dda6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435" status: 200 len: 1238 microversion: 2.1 time: 0.074172 Jul 12 17:48:29.063429 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 531/1068] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:48:28 2022] GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435 => generated 1238 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:48:30.080860 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-cee1611a-90f3-4ff6-b974-73735473a9f5 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:30.081480 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-cee1611a-90f3-4ff6-b974-73735473a9f5 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:30.089000 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cee1611a-90f3-4ff6-b974-73735473a9f5 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:30.089655 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cee1611a-90f3-4ff6-b974-73735473a9f5 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:30.090603 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cee1611a-90f3-4ff6-b974-73735473a9f5 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:30.091136 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cee1611a-90f3-4ff6-b974-73735473a9f5 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:30.160933 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-cee1611a-90f3-4ff6-b974-73735473a9f5 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:48:30.169725 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-cee1611a-90f3-4ff6-b974-73735473a9f5 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435" status: 200 len: 1242 microversion: 2.1 time: 0.093322 Jul 12 17:48:30.170302 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 538/1069] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:48:30 2022] GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435 => generated 1242 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:48:31.188240 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-40ed9ce1-4034-48b7-8be9-7113ffe0a9f6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:31.189223 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-40ed9ce1-4034-48b7-8be9-7113ffe0a9f6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:31.197180 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-40ed9ce1-4034-48b7-8be9-7113ffe0a9f6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:31.197914 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-40ed9ce1-4034-48b7-8be9-7113ffe0a9f6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:31.198729 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-40ed9ce1-4034-48b7-8be9-7113ffe0a9f6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:31.199173 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-40ed9ce1-4034-48b7-8be9-7113ffe0a9f6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:31.262315 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-40ed9ce1-4034-48b7-8be9-7113ffe0a9f6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:48:31.269794 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-40ed9ce1-4034-48b7-8be9-7113ffe0a9f6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435" status: 200 len: 1308 microversion: 2.1 time: 0.086739 Jul 12 17:48:31.270363 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 532/1070] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:48:31 2022] GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435 => generated 1308 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:48:32.287995 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-9f27892b-1c58-47f2-9de9-a8249a435f2c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:32.288608 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-9f27892b-1c58-47f2-9de9-a8249a435f2c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:32.295386 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9f27892b-1c58-47f2-9de9-a8249a435f2c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:32.295830 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9f27892b-1c58-47f2-9de9-a8249a435f2c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:32.296646 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9f27892b-1c58-47f2-9de9-a8249a435f2c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:32.297089 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9f27892b-1c58-47f2-9de9-a8249a435f2c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:32.431163 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-9f27892b-1c58-47f2-9de9-a8249a435f2c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:48:32.438656 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-9f27892b-1c58-47f2-9de9-a8249a435f2c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435" status: 200 len: 1363 microversion: 2.1 time: 0.154694 Jul 12 17:48:32.441121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 539/1071] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:48:32 2022] GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:48:32.810862 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-b2b76040-2498-4754-a967-bac16aaec61a req-4487df13-970d-489b-b0c3-2c3891ee8541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8980ef12-e677-4a55-b5dc-e1c27b4fb435", "tag": "994a1fb7-a76c-4821-99c7-9236c7c846e2"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:48:32.822203 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-b2b76040-2498-4754-a967-bac16aaec61a req-4487df13-970d-489b-b0c3-2c3891ee8541 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:32.822681 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-b2b76040-2498-4754-a967-bac16aaec61a req-4487df13-970d-489b-b0c3-2c3891ee8541 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:32.849062 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-b2b76040-2498-4754-a967-bac16aaec61a req-4487df13-970d-489b-b0c3-2c3891ee8541 service nova] Creating event network-changed:994a1fb7-a76c-4821-99c7-9236c7c846e2 for instance 8980ef12-e677-4a55-b5dc-e1c27b4fb435 on hv-cinder-84875 Jul 12 17:48:32.855456 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-b2b76040-2498-4754-a967-bac16aaec61a req-4487df13-970d-489b-b0c3-2c3891ee8541 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048280 Jul 12 17:48:32.856323 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 533/1072] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:48:33.459128 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-6bf19541-21c6-4a56-aba3-00ea6e7df491 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:33.459983 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-6bf19541-21c6-4a56-aba3-00ea6e7df491 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:33.467042 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6bf19541-21c6-4a56-aba3-00ea6e7df491 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:33.467553 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6bf19541-21c6-4a56-aba3-00ea6e7df491 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:33.468338 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6bf19541-21c6-4a56-aba3-00ea6e7df491 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:33.468782 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6bf19541-21c6-4a56-aba3-00ea6e7df491 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:33.607794 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-6bf19541-21c6-4a56-aba3-00ea6e7df491 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:48:33.615852 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-6bf19541-21c6-4a56-aba3-00ea6e7df491 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435" status: 200 len: 1363 microversion: 2.1 time: 0.161211 Jul 12 17:48:33.616340 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 540/1073] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:48:33 2022] GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:48:34.636595 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-8e1c7b9f-41fa-4e72-bc7a-8433ae7133b5 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:34.637502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-8e1c7b9f-41fa-4e72-bc7a-8433ae7133b5 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:34.644158 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8e1c7b9f-41fa-4e72-bc7a-8433ae7133b5 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:34.644617 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8e1c7b9f-41fa-4e72-bc7a-8433ae7133b5 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:34.645403 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8e1c7b9f-41fa-4e72-bc7a-8433ae7133b5 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:34.646832 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-8e1c7b9f-41fa-4e72-bc7a-8433ae7133b5 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:34.793622 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-8e1c7b9f-41fa-4e72-bc7a-8433ae7133b5 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:48:34.801469 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-8e1c7b9f-41fa-4e72-bc7a-8433ae7133b5 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435" status: 200 len: 1363 microversion: 2.1 time: 0.172704 Jul 12 17:48:34.802117 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 534/1074] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:48:34 2022] GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:48:35.818804 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-7a6f7780-3f70-483e-96c5-92daf8d46511 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:35.819514 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-7a6f7780-3f70-483e-96c5-92daf8d46511 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:35.825919 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7a6f7780-3f70-483e-96c5-92daf8d46511 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:35.826374 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7a6f7780-3f70-483e-96c5-92daf8d46511 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:35.827197 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7a6f7780-3f70-483e-96c5-92daf8d46511 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:35.827635 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7a6f7780-3f70-483e-96c5-92daf8d46511 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:35.960528 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-7a6f7780-3f70-483e-96c5-92daf8d46511 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:48:35.968603 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-7a6f7780-3f70-483e-96c5-92daf8d46511 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435" status: 200 len: 1363 microversion: 2.1 time: 0.154134 Jul 12 17:48:35.969353 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 541/1075] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:48:35 2022] GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:48:36.985974 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-c730368a-06cb-4d8a-94bd-f060b92cded0 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:36.986884 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-c730368a-06cb-4d8a-94bd-f060b92cded0 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:36.993867 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c730368a-06cb-4d8a-94bd-f060b92cded0 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:37.000112 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c730368a-06cb-4d8a-94bd-f060b92cded0 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:37.000112 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c730368a-06cb-4d8a-94bd-f060b92cded0 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:37.000112 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c730368a-06cb-4d8a-94bd-f060b92cded0 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:37.138862 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-c730368a-06cb-4d8a-94bd-f060b92cded0 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:48:37.147484 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-c730368a-06cb-4d8a-94bd-f060b92cded0 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435" status: 200 len: 1363 microversion: 2.1 time: 0.165569 Jul 12 17:48:37.148065 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 535/1076] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:48:36 2022] GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:48:38.164765 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-3a5e90e6-2cca-455c-9ba9-72ac11e9fea8 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:38.166387 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-3a5e90e6-2cca-455c-9ba9-72ac11e9fea8 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:38.173376 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3a5e90e6-2cca-455c-9ba9-72ac11e9fea8 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:38.173832 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3a5e90e6-2cca-455c-9ba9-72ac11e9fea8 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:38.174668 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3a5e90e6-2cca-455c-9ba9-72ac11e9fea8 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:38.175121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3a5e90e6-2cca-455c-9ba9-72ac11e9fea8 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:38.319140 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-3a5e90e6-2cca-455c-9ba9-72ac11e9fea8 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:48:38.328295 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-3a5e90e6-2cca-455c-9ba9-72ac11e9fea8 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435" status: 200 len: 1363 microversion: 2.1 time: 0.166911 Jul 12 17:48:38.328295 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 542/1077] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:48:38 2022] GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:48:39.343134 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-68e440c3-fca9-4165-90a3-749d1b5a1a04 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:39.344557 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-68e440c3-fca9-4165-90a3-749d1b5a1a04 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:39.347129 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell0:SELECT=6 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:48:39.352401 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-68e440c3-fca9-4165-90a3-749d1b5a1a04 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:39.352788 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-68e440c3-fca9-4165-90a3-749d1b5a1a04 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:39.353558 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-68e440c3-fca9-4165-90a3-749d1b5a1a04 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:39.354022 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-68e440c3-fca9-4165-90a3-749d1b5a1a04 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:39.493758 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-68e440c3-fca9-4165-90a3-749d1b5a1a04 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:48:39.503086 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-68e440c3-fca9-4165-90a3-749d1b5a1a04 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435" status: 200 len: 1363 microversion: 2.1 time: 0.163792 Jul 12 17:48:39.503662 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 536/1078] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:48:39 2022] GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:48:39.636298 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-4ec24f98-5476-49be-a76e-cd5a1d32471c req-f9af2b50-561c-45c7-b588-7fb106f6954c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8980ef12-e677-4a55-b5dc-e1c27b4fb435", "name": "network-vif-plugged", "status": "completed", "tag": "994a1fb7-a76c-4821-99c7-9236c7c846e2"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:48:39.650914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell0:SELECT=2 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:48:39.650914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell0:SELECT=6 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:48:39.650914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-4ec24f98-5476-49be-a76e-cd5a1d32471c req-f9af2b50-561c-45c7-b588-7fb106f6954c service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:39.650914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-4ec24f98-5476-49be-a76e-cd5a1d32471c req-f9af2b50-561c-45c7-b588-7fb106f6954c service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:39.662225 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-4ec24f98-5476-49be-a76e-cd5a1d32471c req-f9af2b50-561c-45c7-b588-7fb106f6954c service nova] Creating event network-vif-plugged:994a1fb7-a76c-4821-99c7-9236c7c846e2 for instance 8980ef12-e677-4a55-b5dc-e1c27b4fb435 on hv-cinder-84875 Jul 12 17:48:39.668644 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-4ec24f98-5476-49be-a76e-cd5a1d32471c req-f9af2b50-561c-45c7-b588-7fb106f6954c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036054 Jul 12 17:48:39.669210 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 543/1079] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:48:39.840784 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-fd93e506-b583-4842-9bcd-e41eb95db7a5 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1157865114", "imageRef": "cb077f42-97cd-41cf-8758-764c562534f4", "flavorRef": "452", "networks": [{"uuid": "59cc3c4a-a236-4992-93d9-af42c67d0a53"}]}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:48:39.898863 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.network.neutron [None req-fd93e506-b583-4842-9bcd-e41eb95db7a5 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] validate_networks() for [('59cc3c4a-a236-4992-93d9-af42c67d0a53', None, None, None, None, None)] {{(pid=130058) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:48:40.259682 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-fd93e506-b583-4842-9bcd-e41eb95db7a5 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Flavor limits 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:48:40.260193 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-fd93e506-b583-4842-9bcd-e41eb95db7a5 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Image limits 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:48:40.260725 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-fd93e506-b583-4842-9bcd-e41eb95db7a5 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Flavor pref 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:48:40.261144 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-fd93e506-b583-4842-9bcd-e41eb95db7a5 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Image pref 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:48:40.261555 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-fd93e506-b583-4842-9bcd-e41eb95db7a5 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:48:40.270504 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fd93e506-b583-4842-9bcd-e41eb95db7a5 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:40.271489 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fd93e506-b583-4842-9bcd-e41eb95db7a5 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:40.272806 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fd93e506-b583-4842-9bcd-e41eb95db7a5 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:40.273246 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-fd93e506-b583-4842-9bcd-e41eb95db7a5 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:40.293262 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-fd93e506-b583-4842-9bcd-e41eb95db7a5 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Getting quotas for project c3b0319262bc468d82fa3fba94540142. Resources: {'cores', 'instances', 'ram'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:48:40.297393 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-fd93e506-b583-4842-9bcd-e41eb95db7a5 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Getting quotas for user 01d3c959a87247cd833db555fdef9af5 and project c3b0319262bc468d82fa3fba94540142. Resources: {'cores', 'instances', 'ram'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:48:40.309074 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-fd93e506-b583-4842-9bcd-e41eb95db7a5 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Going to run 1 instances... {{(pid=130058) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:48:40.311357 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-fd93e506-b583-4842-9bcd-e41eb95db7a5 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 5b6a76fc-e670-438a-af22-12a1772e5301] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb077f42-97cd-41cf-8758-764c562534f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:48:40.513716 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-fd93e506-b583-4842-9bcd-e41eb95db7a5 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.676780 Jul 12 17:48:40.515444 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 537/1080] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 12 17:48:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:48:40.522589 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-bfebc6ac-e8ae-4944-8fac-85bbba3bb46e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:40.523667 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-bfebc6ac-e8ae-4944-8fac-85bbba3bb46e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:40.526576 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-3d3c2831-64f5-4899-93e8-7013a3f68274 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:40.529638 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-3d3c2831-64f5-4899-93e8-7013a3f68274 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 5b6a76fc-e670-438a-af22-12a1772e5301] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:40.532014 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bfebc6ac-e8ae-4944-8fac-85bbba3bb46e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:40.532999 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bfebc6ac-e8ae-4944-8fac-85bbba3bb46e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:40.534028 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bfebc6ac-e8ae-4944-8fac-85bbba3bb46e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:40.534881 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bfebc6ac-e8ae-4944-8fac-85bbba3bb46e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:40.607953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-3d3c2831-64f5-4899-93e8-7013a3f68274 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:48:40.615299 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-3d3c2831-64f5-4899-93e8-7013a3f68274 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301" status: 200 len: 1219 microversion: 2.1 time: 0.093720 Jul 12 17:48:40.615889 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 538/1081] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:48:40 2022] GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:48:40.696715 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-bfebc6ac-e8ae-4944-8fac-85bbba3bb46e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:48:40.705545 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-bfebc6ac-e8ae-4944-8fac-85bbba3bb46e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435" status: 200 len: 1363 microversion: 2.1 time: 0.188033 Jul 12 17:48:40.706010 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 544/1082] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:48:40 2022] GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:48:41.633270 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-a7abcba3-4dc5-4df3-8731-aa161523ed5e tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:41.633826 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-a7abcba3-4dc5-4df3-8731-aa161523ed5e tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 5b6a76fc-e670-438a-af22-12a1772e5301] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:41.641158 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a7abcba3-4dc5-4df3-8731-aa161523ed5e tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:41.653040 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a7abcba3-4dc5-4df3-8731-aa161523ed5e tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:41.653040 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a7abcba3-4dc5-4df3-8731-aa161523ed5e tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:41.653040 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a7abcba3-4dc5-4df3-8731-aa161523ed5e tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:41.708257 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-a7abcba3-4dc5-4df3-8731-aa161523ed5e tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:48:41.715689 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-a7abcba3-4dc5-4df3-8731-aa161523ed5e tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301" status: 200 len: 1223 microversion: 2.1 time: 0.087592 Jul 12 17:48:41.717345 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 539/1083] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:48:41 2022] GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:48:41.723070 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-4e92dccd-ef93-4a9c-85dd-b56da9a65316 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:41.723801 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-4e92dccd-ef93-4a9c-85dd-b56da9a65316 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:41.730943 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4e92dccd-ef93-4a9c-85dd-b56da9a65316 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:41.731551 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4e92dccd-ef93-4a9c-85dd-b56da9a65316 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:41.732329 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4e92dccd-ef93-4a9c-85dd-b56da9a65316 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:41.732773 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4e92dccd-ef93-4a9c-85dd-b56da9a65316 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:41.863769 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-4e92dccd-ef93-4a9c-85dd-b56da9a65316 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:48:41.872224 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-4e92dccd-ef93-4a9c-85dd-b56da9a65316 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435" status: 200 len: 1363 microversion: 2.1 time: 0.153343 Jul 12 17:48:41.872799 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 545/1084] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:48:41 2022] GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:48:42.732117 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-af73f2df-76b1-4857-8fd9-c55f4b57585c tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:42.732647 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-af73f2df-76b1-4857-8fd9-c55f4b57585c tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 5b6a76fc-e670-438a-af22-12a1772e5301] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:42.739235 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-af73f2df-76b1-4857-8fd9-c55f4b57585c tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:42.740328 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-af73f2df-76b1-4857-8fd9-c55f4b57585c tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:42.741156 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-af73f2df-76b1-4857-8fd9-c55f4b57585c tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:42.741593 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-af73f2df-76b1-4857-8fd9-c55f4b57585c tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:42.805127 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-af73f2df-76b1-4857-8fd9-c55f4b57585c tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:48:42.812791 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-af73f2df-76b1-4857-8fd9-c55f4b57585c tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301" status: 200 len: 1271 microversion: 2.1 time: 0.084671 Jul 12 17:48:42.813363 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 540/1085] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:48:42 2022] GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:48:42.889035 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-668e7490-3f8e-4f24-9a09-98242a29b21d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:42.889744 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-668e7490-3f8e-4f24-9a09-98242a29b21d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:42.896482 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-668e7490-3f8e-4f24-9a09-98242a29b21d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:42.896931 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-668e7490-3f8e-4f24-9a09-98242a29b21d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:42.897711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-668e7490-3f8e-4f24-9a09-98242a29b21d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:42.898151 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-668e7490-3f8e-4f24-9a09-98242a29b21d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:43.029018 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-668e7490-3f8e-4f24-9a09-98242a29b21d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:48:43.037389 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-668e7490-3f8e-4f24-9a09-98242a29b21d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435" status: 200 len: 1549 microversion: 2.1 time: 0.151735 Jul 12 17:48:43.038250 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 546/1086] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:48:42 2022] GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:48:43.055086 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-30c6f273-a784-4627-b5aa-8babd4f4591a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:43.055615 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-30c6f273-a784-4627-b5aa-8babd4f4591a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:43.061606 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-30c6f273-a784-4627-b5aa-8babd4f4591a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:43.062062 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-30c6f273-a784-4627-b5aa-8babd4f4591a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:43.062863 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-30c6f273-a784-4627-b5aa-8babd4f4591a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:43.063308 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-30c6f273-a784-4627-b5aa-8babd4f4591a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:43.141378 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-30c6f273-a784-4627-b5aa-8babd4f4591a tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091359 Jul 12 17:48:43.141974 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 541/1087] 10.222.0.16 () {58 vars in 1274 bytes} [Tue Jul 12 17:48:43 2022] GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:48:43.835964 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-e6f44f48-55b9-4618-b9d1-d84708c89b1f tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:43.836581 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-e6f44f48-55b9-4618-b9d1-d84708c89b1f tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 5b6a76fc-e670-438a-af22-12a1772e5301] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:43.842751 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e6f44f48-55b9-4618-b9d1-d84708c89b1f tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:43.843461 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e6f44f48-55b9-4618-b9d1-d84708c89b1f tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:43.844035 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e6f44f48-55b9-4618-b9d1-d84708c89b1f tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:43.844481 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e6f44f48-55b9-4618-b9d1-d84708c89b1f tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:43.912305 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-e6f44f48-55b9-4618-b9d1-d84708c89b1f tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:48:43.920135 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-e6f44f48-55b9-4618-b9d1-d84708c89b1f tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301" status: 200 len: 1277 microversion: 2.1 time: 0.088908 Jul 12 17:48:43.920723 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 547/1088] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:48:43 2022] GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301 => generated 1277 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:48:44.823952 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-31ee2f3a-c14f-4418-bd43-c3793ed5e9bc req-ff2fca50-d821-4754-8384-0f2c42a9bdad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8980ef12-e677-4a55-b5dc-e1c27b4fb435", "tag": "994a1fb7-a76c-4821-99c7-9236c7c846e2"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:48:44.835549 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-31ee2f3a-c14f-4418-bd43-c3793ed5e9bc req-ff2fca50-d821-4754-8384-0f2c42a9bdad service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:44.836364 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-31ee2f3a-c14f-4418-bd43-c3793ed5e9bc req-ff2fca50-d821-4754-8384-0f2c42a9bdad service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:44.848126 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-31ee2f3a-c14f-4418-bd43-c3793ed5e9bc req-ff2fca50-d821-4754-8384-0f2c42a9bdad service nova] Creating event network-changed:994a1fb7-a76c-4821-99c7-9236c7c846e2 for instance 8980ef12-e677-4a55-b5dc-e1c27b4fb435 on hv-cinder-84875 Jul 12 17:48:44.854952 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-31ee2f3a-c14f-4418-bd43-c3793ed5e9bc req-ff2fca50-d821-4754-8384-0f2c42a9bdad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035935 Jul 12 17:48:44.859719 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 542/1089] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:48:44.937758 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ea0b886e-6cd3-4bf8-a03a-60973144e48a tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:44.938373 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-ea0b886e-6cd3-4bf8-a03a-60973144e48a tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 5b6a76fc-e670-438a-af22-12a1772e5301] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:44.945818 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ea0b886e-6cd3-4bf8-a03a-60973144e48a tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:44.946355 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ea0b886e-6cd3-4bf8-a03a-60973144e48a tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:44.947186 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ea0b886e-6cd3-4bf8-a03a-60973144e48a tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:44.947629 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ea0b886e-6cd3-4bf8-a03a-60973144e48a tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:45.211801 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-ea0b886e-6cd3-4bf8-a03a-60973144e48a tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:48:45.221319 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-ea0b886e-6cd3-4bf8-a03a-60973144e48a tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301" status: 200 len: 1319 microversion: 2.1 time: 0.287739 Jul 12 17:48:45.224067 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 548/1090] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:48:44 2022] GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301 => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:48:46.239331 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-2805e3a0-5b09-48b1-a65e-9ffd5369c6ce tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:46.240660 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-2805e3a0-5b09-48b1-a65e-9ffd5369c6ce tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 5b6a76fc-e670-438a-af22-12a1772e5301] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:46.246804 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2805e3a0-5b09-48b1-a65e-9ffd5369c6ce tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:46.247241 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2805e3a0-5b09-48b1-a65e-9ffd5369c6ce tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:46.248002 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2805e3a0-5b09-48b1-a65e-9ffd5369c6ce tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:46.248440 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2805e3a0-5b09-48b1-a65e-9ffd5369c6ce tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:46.384328 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-2805e3a0-5b09-48b1-a65e-9ffd5369c6ce tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:48:46.391875 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-2805e3a0-5b09-48b1-a65e-9ffd5369c6ce tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301" status: 200 len: 1319 microversion: 2.1 time: 0.157174 Jul 12 17:48:46.392393 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 543/1091] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:48:46 2022] GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:48:46.874064 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-b4ad44e2-6435-47d6-b3e4-652f1b7c58c7 req-6ddfc58a-3446-4113-8311-6f1d46a7977f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b6a76fc-e670-438a-af22-12a1772e5301", "tag": "0688383a-1589-4059-b874-e659acf36f0b"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:48:46.882696 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-b4ad44e2-6435-47d6-b3e4-652f1b7c58c7 req-6ddfc58a-3446-4113-8311-6f1d46a7977f service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:46.883142 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-b4ad44e2-6435-47d6-b3e4-652f1b7c58c7 req-6ddfc58a-3446-4113-8311-6f1d46a7977f service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:46.894946 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-b4ad44e2-6435-47d6-b3e4-652f1b7c58c7 req-6ddfc58a-3446-4113-8311-6f1d46a7977f service nova] Creating event network-changed:0688383a-1589-4059-b874-e659acf36f0b for instance 5b6a76fc-e670-438a-af22-12a1772e5301 on hv-cinder-84875 Jul 12 17:48:46.900530 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-b4ad44e2-6435-47d6-b3e4-652f1b7c58c7 req-6ddfc58a-3446-4113-8311-6f1d46a7977f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030125 Jul 12 17:48:46.901117 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 549/1092] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:48:47.408635 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-32599aa0-20ef-4fdb-88c3-439f121b4dd4 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:47.409277 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-32599aa0-20ef-4fdb-88c3-439f121b4dd4 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 5b6a76fc-e670-438a-af22-12a1772e5301] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:47.416046 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-32599aa0-20ef-4fdb-88c3-439f121b4dd4 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:47.416502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-32599aa0-20ef-4fdb-88c3-439f121b4dd4 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:47.417279 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-32599aa0-20ef-4fdb-88c3-439f121b4dd4 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:47.417715 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-32599aa0-20ef-4fdb-88c3-439f121b4dd4 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:47.661643 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-32599aa0-20ef-4fdb-88c3-439f121b4dd4 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:48:47.669676 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-32599aa0-20ef-4fdb-88c3-439f121b4dd4 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301" status: 200 len: 1319 microversion: 2.1 time: 0.264871 Jul 12 17:48:47.670358 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 544/1093] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:48:47 2022] GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:48:48.692051 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-44243744-1fe1-4c82-9fbf-18e20a72c38f tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:48.694112 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-44243744-1fe1-4c82-9fbf-18e20a72c38f tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 5b6a76fc-e670-438a-af22-12a1772e5301] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:48.700768 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-44243744-1fe1-4c82-9fbf-18e20a72c38f tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:48.701220 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-44243744-1fe1-4c82-9fbf-18e20a72c38f tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:48.702356 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-44243744-1fe1-4c82-9fbf-18e20a72c38f tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:48.702729 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-44243744-1fe1-4c82-9fbf-18e20a72c38f tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:48.707043 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=100 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:48:48.848571 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-44243744-1fe1-4c82-9fbf-18e20a72c38f tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:48:48.856745 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-44243744-1fe1-4c82-9fbf-18e20a72c38f tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301" status: 200 len: 1319 microversion: 2.1 time: 0.172697 Jul 12 17:48:48.857309 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 550/1094] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:48:48 2022] GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:48:49.874032 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-1d7fe810-0b80-4485-9781-15415664d1cf tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:49.874675 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-1d7fe810-0b80-4485-9781-15415664d1cf tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 5b6a76fc-e670-438a-af22-12a1772e5301] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:49.877128 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:48:49.882760 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1d7fe810-0b80-4485-9781-15415664d1cf tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:49.883211 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1d7fe810-0b80-4485-9781-15415664d1cf tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:49.883985 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1d7fe810-0b80-4485-9781-15415664d1cf tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:49.884426 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-1d7fe810-0b80-4485-9781-15415664d1cf tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:49.888441 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:48:50.016380 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-1d7fe810-0b80-4485-9781-15415664d1cf tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:48:50.024247 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-1d7fe810-0b80-4485-9781-15415664d1cf tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301" status: 200 len: 1319 microversion: 2.1 time: 0.154030 Jul 12 17:48:50.024828 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 545/1095] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:48:49 2022] GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:48:51.041942 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-888e28de-70d4-4284-895e-650bbfe1fe25 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:51.042622 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-888e28de-70d4-4284-895e-650bbfe1fe25 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 5b6a76fc-e670-438a-af22-12a1772e5301] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:51.045063 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:48:51.049783 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-888e28de-70d4-4284-895e-650bbfe1fe25 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:51.050231 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-888e28de-70d4-4284-895e-650bbfe1fe25 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:51.058315 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-888e28de-70d4-4284-895e-650bbfe1fe25 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:51.058315 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-888e28de-70d4-4284-895e-650bbfe1fe25 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:51.183626 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-888e28de-70d4-4284-895e-650bbfe1fe25 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:48:51.191024 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-888e28de-70d4-4284-895e-650bbfe1fe25 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301" status: 200 len: 1319 microversion: 2.1 time: 0.153093 Jul 12 17:48:51.191590 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 551/1096] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:48:51 2022] GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:48:51.737606 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell0:SELECT=2 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:48:51.738387 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell0:SELECT=8 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:48:51.743080 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-0506213a-0b02-4bb5-a55a-e79c203233db req-2353b8d3-109f-4263-b52e-6281cab5eeca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b6a76fc-e670-438a-af22-12a1772e5301", "name": "network-vif-plugged", "status": "completed", "tag": "0688383a-1589-4059-b874-e659acf36f0b"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:48:51.751377 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-0506213a-0b02-4bb5-a55a-e79c203233db req-2353b8d3-109f-4263-b52e-6281cab5eeca service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:51.758585 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-0506213a-0b02-4bb5-a55a-e79c203233db req-2353b8d3-109f-4263-b52e-6281cab5eeca service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:51.763490 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-0506213a-0b02-4bb5-a55a-e79c203233db req-2353b8d3-109f-4263-b52e-6281cab5eeca service nova] Creating event network-vif-plugged:0688383a-1589-4059-b874-e659acf36f0b for instance 5b6a76fc-e670-438a-af22-12a1772e5301 on hv-cinder-84875 Jul 12 17:48:51.768383 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-0506213a-0b02-4bb5-a55a-e79c203233db req-2353b8d3-109f-4263-b52e-6281cab5eeca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031789 Jul 12 17:48:51.769130 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 546/1097] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:48:52.207914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-83e07a3f-2201-49fe-994f-00c19b43b8de tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:52.208586 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-83e07a3f-2201-49fe-994f-00c19b43b8de tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 5b6a76fc-e670-438a-af22-12a1772e5301] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:52.216460 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-83e07a3f-2201-49fe-994f-00c19b43b8de tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:52.219604 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-83e07a3f-2201-49fe-994f-00c19b43b8de tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:52.219604 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-83e07a3f-2201-49fe-994f-00c19b43b8de tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:52.219604 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-83e07a3f-2201-49fe-994f-00c19b43b8de tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:52.349197 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-83e07a3f-2201-49fe-994f-00c19b43b8de tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:48:52.356746 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-83e07a3f-2201-49fe-994f-00c19b43b8de tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301" status: 200 len: 1319 microversion: 2.1 time: 0.152682 Jul 12 17:48:52.357342 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 552/1098] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:48:52 2022] GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:48:53.374125 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-01ccca0b-a185-4c2f-a5a7-f8ecf7007d66 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:53.374873 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-01ccca0b-a185-4c2f-a5a7-f8ecf7007d66 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 5b6a76fc-e670-438a-af22-12a1772e5301] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:53.382870 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-01ccca0b-a185-4c2f-a5a7-f8ecf7007d66 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:53.383545 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-01ccca0b-a185-4c2f-a5a7-f8ecf7007d66 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:53.384307 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-01ccca0b-a185-4c2f-a5a7-f8ecf7007d66 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:53.384750 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-01ccca0b-a185-4c2f-a5a7-f8ecf7007d66 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:53.514892 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-01ccca0b-a185-4c2f-a5a7-f8ecf7007d66 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:48:53.522953 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-01ccca0b-a185-4c2f-a5a7-f8ecf7007d66 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301" status: 200 len: 1319 microversion: 2.1 time: 0.152928 Jul 12 17:48:53.523539 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 547/1099] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:48:53 2022] GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:48:54.540133 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-d8b16e21-b9da-4958-b082-c99e287f308c tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:48:54.540747 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-d8b16e21-b9da-4958-b082-c99e287f308c tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 5b6a76fc-e670-438a-af22-12a1772e5301] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:48:54.547687 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d8b16e21-b9da-4958-b082-c99e287f308c tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:54.548146 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d8b16e21-b9da-4958-b082-c99e287f308c tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:54.549089 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d8b16e21-b9da-4958-b082-c99e287f308c tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:48:54.549534 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d8b16e21-b9da-4958-b082-c99e287f308c tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:48:54.684768 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-d8b16e21-b9da-4958-b082-c99e287f308c tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:48:54.692751 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-d8b16e21-b9da-4958-b082-c99e287f308c tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301" status: 200 len: 1509 microversion: 2.1 time: 0.157051 Jul 12 17:48:54.693332 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 553/1100] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:48:54 2022] GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:49:11.067258 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-a0c42a2a-1dc3-4e86-b99f-cd0830678404 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc7a4a4e-4360-4785-acc7-93b62ddd7d4c", "device": "/dev/sdb"}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:49:11.068815 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-a0c42a2a-1dc3-4e86-b99f-cd0830678404 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 5b6a76fc-e670-438a-af22-12a1772e5301] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:11.070802 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_api:SELECT=5 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:49:11.071588 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=13 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:49:11.077266 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a0c42a2a-1dc3-4e86-b99f-cd0830678404 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:11.077899 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a0c42a2a-1dc3-4e86-b99f-cd0830678404 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:11.078699 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a0c42a2a-1dc3-4e86-b99f-cd0830678404 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:11.079141 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-a0c42a2a-1dc3-4e86-b99f-cd0830678404 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:12.017309 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-a0c42a2a-1dc3-4e86-b99f-cd0830678404 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "POST /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.954197 Jul 12 17:49:12.018110 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 548/1101] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jul 12 17:49:11 2022] POST /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301/os-volume_attachments => generated 194 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:49:21.048212 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-92a204c9-87b6-49ad-9181-e5c416e5c580 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:21.048926 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-92a204c9-87b6-49ad-9181-e5c416e5c580 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:21.050910 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_api:SELECT=5 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:49:21.051718 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=22 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:49:21.056528 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-92a204c9-87b6-49ad-9181-e5c416e5c580 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:21.058724 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-92a204c9-87b6-49ad-9181-e5c416e5c580 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:21.058724 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-92a204c9-87b6-49ad-9181-e5c416e5c580 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:21.058724 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-92a204c9-87b6-49ad-9181-e5c416e5c580 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:21.082814 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-92a204c9-87b6-49ad-9181-e5c416e5c580 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435/ips" status: 200 len: 146 microversion: 2.1 time: 0.038651 Jul 12 17:49:21.083447 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 554/1102] 10.222.0.16 () {58 vars in 1247 bytes} [Tue Jul 12 17:49:21 2022] GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:49:23.755263 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-faa2db9b-bdc6-4e5c-af64-2f0dcef29506 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2b469dc-74e9-4561-9d4f-b49b55cdc09a"}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:49:23.756467 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-faa2db9b-bdc6-4e5c-af64-2f0dcef29506 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:23.759013 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_api:SELECT=2 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:49:23.759656 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:49:23.764598 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-faa2db9b-bdc6-4e5c-af64-2f0dcef29506 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:23.765671 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-faa2db9b-bdc6-4e5c-af64-2f0dcef29506 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:23.766704 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-faa2db9b-bdc6-4e5c-af64-2f0dcef29506 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:23.767147 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-faa2db9b-bdc6-4e5c-af64-2f0dcef29506 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:24.529637 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-faa2db9b-bdc6-4e5c-af64-2f0dcef29506 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "POST /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.778514 Jul 12 17:49:24.530242 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 549/1103] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jul 12 17:49:23 2022] POST /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435/os-volume_attachments => generated 194 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:49:35.176053 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a33031a5-a4ac-4bfc-817e-bbc12878502d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:35.185884 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-a33031a5-a4ac-4bfc-817e-bbc12878502d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:35.185884 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_api:SELECT=2 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:49:35.185884 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a33031a5-a4ac-4bfc-817e-bbc12878502d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:35.185884 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a33031a5-a4ac-4bfc-817e-bbc12878502d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:35.185884 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a33031a5-a4ac-4bfc-817e-bbc12878502d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:35.186515 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a33031a5-a4ac-4bfc-817e-bbc12878502d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:35.217008 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-a33031a5-a4ac-4bfc-817e-bbc12878502d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045843 Jul 12 17:49:35.217570 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 555/1104] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:49:35 2022] GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:49:35.226278 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_api:SELECT=2 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:49:35.226870 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:49:35.231067 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-d9b4ed59-87a6-4954-956e-b51c1d59941e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:35.232058 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-d9b4ed59-87a6-4954-956e-b51c1d59941e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:35.238027 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d9b4ed59-87a6-4954-956e-b51c1d59941e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:35.238499 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d9b4ed59-87a6-4954-956e-b51c1d59941e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:35.239274 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d9b4ed59-87a6-4954-956e-b51c1d59941e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:35.239702 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d9b4ed59-87a6-4954-956e-b51c1d59941e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:35.270226 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-d9b4ed59-87a6-4954-956e-b51c1d59941e tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435/os-volume_attachments/b2b469dc-74e9-4561-9d4f-b49b55cdc09a" status: 200 len: 194 microversion: 2.1 time: 0.045491 Jul 12 17:49:35.271037 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 550/1105] 10.222.0.16 () {58 vars in 1412 bytes} [Tue Jul 12 17:49:35 2022] GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435/os-volume_attachments/b2b469dc-74e9-4561-9d4f-b49b55cdc09a => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:49:36.247341 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-4e62d594-17ce-4749-b61a-48e63818340f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:36.248074 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-4e62d594-17ce-4749-b61a-48e63818340f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: d360de38-a762-403b-bed3-d9ac43ffa09d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:36.249572 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-d84c80ef-3e17-4ebf-9bc6-9e0eeaaae54c req-76516de8-8e6a-4d36-bf1a-cdcd04f15dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d360de38-a762-403b-bed3-d9ac43ffa09d", "tag": "2b3ccb8b-4fb9-4bed-b329-5b6bbfc9647b"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:49:36.255455 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4e62d594-17ce-4749-b61a-48e63818340f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:36.256062 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4e62d594-17ce-4749-b61a-48e63818340f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:36.257056 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4e62d594-17ce-4749-b61a-48e63818340f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:36.257500 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4e62d594-17ce-4749-b61a-48e63818340f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:36.262074 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-d84c80ef-3e17-4ebf-9bc6-9e0eeaaae54c req-76516de8-8e6a-4d36-bf1a-cdcd04f15dc3 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:36.262662 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-d84c80ef-3e17-4ebf-9bc6-9e0eeaaae54c req-76516de8-8e6a-4d36-bf1a-cdcd04f15dc3 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:36.279464 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-d84c80ef-3e17-4ebf-9bc6-9e0eeaaae54c req-76516de8-8e6a-4d36-bf1a-cdcd04f15dc3 service nova] Creating event network-changed:2b3ccb8b-4fb9-4bed-b329-5b6bbfc9647b for instance d360de38-a762-403b-bed3-d9ac43ffa09d on hv-cinder-84875 Jul 12 17:49:36.285030 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-d84c80ef-3e17-4ebf-9bc6-9e0eeaaae54c req-76516de8-8e6a-4d36-bf1a-cdcd04f15dc3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039853 Jul 12 17:49:36.285354 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-4e62d594-17ce-4749-b61a-48e63818340f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: d360de38-a762-403b-bed3-d9ac43ffa09d] Going to try to terminate instance {{(pid=130059) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:49:36.285808 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 551/1106] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:49:36.629049 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-4e62d594-17ce-4749-b61a-48e63818340f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d" status: 204 len: 0 microversion: 2.1 time: 0.386221 Jul 12 17:49:36.629700 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 556/1107] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 12 17:49:36 2022] DELETE /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:49:36.639462 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b5a5d54f-b981-47b4-9058-02ecc1420fbe tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:36.640179 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-b5a5d54f-b981-47b4-9058-02ecc1420fbe tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: d360de38-a762-403b-bed3-d9ac43ffa09d] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:36.647929 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b5a5d54f-b981-47b4-9058-02ecc1420fbe tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:36.648425 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b5a5d54f-b981-47b4-9058-02ecc1420fbe tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:36.649380 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b5a5d54f-b981-47b4-9058-02ecc1420fbe tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:36.649984 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b5a5d54f-b981-47b4-9058-02ecc1420fbe tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:36.748638 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-099006c9-6084-43a2-a3d2-5ead6628cc05 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:36.749348 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-099006c9-6084-43a2-a3d2-5ead6628cc05 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 5b6a76fc-e670-438a-af22-12a1772e5301] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:36.755733 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-099006c9-6084-43a2-a3d2-5ead6628cc05 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:36.756303 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-099006c9-6084-43a2-a3d2-5ead6628cc05 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:36.757264 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-099006c9-6084-43a2-a3d2-5ead6628cc05 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:36.757795 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-099006c9-6084-43a2-a3d2-5ead6628cc05 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:36.792962 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-b5a5d54f-b981-47b4-9058-02ecc1420fbe tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:49:36.801049 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-b5a5d54f-b981-47b4-9058-02ecc1420fbe tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d" status: 200 len: 1577 microversion: 2.1 time: 0.166070 Jul 12 17:49:36.801805 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 552/1108] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:49:36 2022] GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:49:36.906456 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.objects.instance [None req-099006c9-6084-43a2-a3d2-5ead6628cc05 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lazy-loading 'services' on Instance uuid 5b6a76fc-e670-438a-af22-12a1772e5301 {{(pid=130059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:49:36.924671 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-be9f2c29-5d31-4fed-b3d7-3af1e24d30d8 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a6f9c73-65af-4ad2-9443-14becdc5f52e"}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:49:36.925798 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-be9f2c29-5d31-4fed-b3d7-3af1e24d30d8 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:36.932234 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-be9f2c29-5d31-4fed-b3d7-3af1e24d30d8 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:36.932685 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-be9f2c29-5d31-4fed-b3d7-3af1e24d30d8 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:36.933669 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-be9f2c29-5d31-4fed-b3d7-3af1e24d30d8 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:36.934118 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-be9f2c29-5d31-4fed-b3d7-3af1e24d30d8 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:37.183598 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-099006c9-6084-43a2-a3d2-5ead6628cc05 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301/os-volume_attachments/cc7a4a4e-4360-4785-acc7-93b62ddd7d4c" status: 202 len: 0 microversion: 2.1 time: 0.439131 Jul 12 17:49:37.184240 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 557/1109] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jul 12 17:49:36 2022] DELETE /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301/os-volume_attachments/cc7a4a4e-4360-4785-acc7-93b62ddd7d4c => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 17:49:37.820045 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-5857f8f6-32e0-4080-94d7-ea44cc0030a9 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:37.820756 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-5857f8f6-32e0-4080-94d7-ea44cc0030a9 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: d360de38-a762-403b-bed3-d9ac43ffa09d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:37.827501 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5857f8f6-32e0-4080-94d7-ea44cc0030a9 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:37.827954 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5857f8f6-32e0-4080-94d7-ea44cc0030a9 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:37.833663 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5857f8f6-32e0-4080-94d7-ea44cc0030a9 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:37.833663 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5857f8f6-32e0-4080-94d7-ea44cc0030a9 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:37.970580 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-5857f8f6-32e0-4080-94d7-ea44cc0030a9 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:49:37.978212 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-5857f8f6-32e0-4080-94d7-ea44cc0030a9 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d" status: 200 len: 1577 microversion: 2.1 time: 0.162806 Jul 12 17:49:37.978824 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 558/1110] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:49:37 2022] GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:49:38.700872 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-be9f2c29-5d31-4fed-b3d7-3af1e24d30d8 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "POST /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.780005 Jul 12 17:49:38.701847 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 553/1111] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jul 12 17:49:36 2022] POST /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435/os-volume_attachments => generated 194 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:49:38.996544 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-cbf67f6c-42f2-41ee-ab00-aa1aef0ff3ef tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:38.997073 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-cbf67f6c-42f2-41ee-ab00-aa1aef0ff3ef tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: d360de38-a762-403b-bed3-d9ac43ffa09d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:39.004346 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cbf67f6c-42f2-41ee-ab00-aa1aef0ff3ef tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:39.004813 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cbf67f6c-42f2-41ee-ab00-aa1aef0ff3ef tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:39.006239 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cbf67f6c-42f2-41ee-ab00-aa1aef0ff3ef tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:39.006810 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cbf67f6c-42f2-41ee-ab00-aa1aef0ff3ef tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:39.147433 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-cbf67f6c-42f2-41ee-ab00-aa1aef0ff3ef tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:49:39.155144 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-cbf67f6c-42f2-41ee-ab00-aa1aef0ff3ef tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d" status: 200 len: 1458 microversion: 2.1 time: 0.162746 Jul 12 17:49:39.155724 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 559/1112] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:49:38 2022] GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d => generated 1458 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:49:39.225461 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-f794f94d-0e20-44ae-b767-37ef36898caf req-3cf7732c-6b49-4e85-9ecf-3dfa012b8fbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d360de38-a762-403b-bed3-d9ac43ffa09d", "name": "network-vif-deleted", "tag": "2b3ccb8b-4fb9-4bed-b329-5b6bbfc9647b"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:49:39.234892 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-f794f94d-0e20-44ae-b767-37ef36898caf req-3cf7732c-6b49-4e85-9ecf-3dfa012b8fbd service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:39.235333 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-f794f94d-0e20-44ae-b767-37ef36898caf req-3cf7732c-6b49-4e85-9ecf-3dfa012b8fbd service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:39.246200 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-f794f94d-0e20-44ae-b767-37ef36898caf req-3cf7732c-6b49-4e85-9ecf-3dfa012b8fbd service nova] Creating event network-vif-deleted:2b3ccb8b-4fb9-4bed-b329-5b6bbfc9647b for instance d360de38-a762-403b-bed3-d9ac43ffa09d on hv-cinder-84875 Jul 12 17:49:39.250963 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-f794f94d-0e20-44ae-b767-37ef36898caf req-3cf7732c-6b49-4e85-9ecf-3dfa012b8fbd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029470 Jul 12 17:49:39.251504 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 554/1113] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:49:39.367649 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-d53969bc-53da-4994-83d6-257e397609fd tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:39.370315 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-d53969bc-53da-4994-83d6-257e397609fd tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 5b6a76fc-e670-438a-af22-12a1772e5301] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:39.374145 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d53969bc-53da-4994-83d6-257e397609fd tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:39.374637 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d53969bc-53da-4994-83d6-257e397609fd tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:39.375411 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d53969bc-53da-4994-83d6-257e397609fd tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:39.375914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d53969bc-53da-4994-83d6-257e397609fd tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:39.402936 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-d53969bc-53da-4994-83d6-257e397609fd tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 5b6a76fc-e670-438a-af22-12a1772e5301] Going to try to terminate instance {{(pid=130059) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:49:39.679296 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-d53969bc-53da-4994-83d6-257e397609fd tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301" status: 204 len: 0 microversion: 2.1 time: 0.315349 Jul 12 17:49:39.679889 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 560/1114] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 12 17:49:39 2022] DELETE /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 17:49:39.688819 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-97ccab11-18dd-4c50-9f54-165fdab04e5a tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:39.689874 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-97ccab11-18dd-4c50-9f54-165fdab04e5a tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 5b6a76fc-e670-438a-af22-12a1772e5301] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:39.696924 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-97ccab11-18dd-4c50-9f54-165fdab04e5a tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:39.697383 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-97ccab11-18dd-4c50-9f54-165fdab04e5a tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:39.698157 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-97ccab11-18dd-4c50-9f54-165fdab04e5a tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:39.698633 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-97ccab11-18dd-4c50-9f54-165fdab04e5a tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:39.838390 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-97ccab11-18dd-4c50-9f54-165fdab04e5a tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:49:39.847388 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-97ccab11-18dd-4c50-9f54-165fdab04e5a tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301" status: 200 len: 1515 microversion: 2.1 time: 0.162751 Jul 12 17:49:39.848131 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 555/1115] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:49:39 2022] GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:49:40.174472 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-19451bfb-0552-4f60-bda1-f416200b1a10 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:40.175187 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-19451bfb-0552-4f60-bda1-f416200b1a10 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: d360de38-a762-403b-bed3-d9ac43ffa09d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:40.181715 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-19451bfb-0552-4f60-bda1-f416200b1a10 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:40.182171 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-19451bfb-0552-4f60-bda1-f416200b1a10 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:40.182991 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-19451bfb-0552-4f60-bda1-f416200b1a10 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:40.183452 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-19451bfb-0552-4f60-bda1-f416200b1a10 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:40.247609 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-19451bfb-0552-4f60-bda1-f416200b1a10 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:49:40.257031 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-19451bfb-0552-4f60-bda1-f416200b1a10 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d" status: 200 len: 1224 microversion: 2.1 time: 0.087682 Jul 12 17:49:40.257607 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 561/1116] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:49:40 2022] GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:49:40.867177 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-20d73bc7-4894-4f8b-913c-99e6e82c0b01 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:40.867850 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-20d73bc7-4894-4f8b-913c-99e6e82c0b01 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 5b6a76fc-e670-438a-af22-12a1772e5301] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:40.874576 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-20d73bc7-4894-4f8b-913c-99e6e82c0b01 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:40.875032 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-20d73bc7-4894-4f8b-913c-99e6e82c0b01 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:40.875803 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-20d73bc7-4894-4f8b-913c-99e6e82c0b01 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:40.876630 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-20d73bc7-4894-4f8b-913c-99e6e82c0b01 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:41.005702 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-20d73bc7-4894-4f8b-913c-99e6e82c0b01 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:49:41.013424 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-20d73bc7-4894-4f8b-913c-99e6e82c0b01 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301" status: 200 len: 1515 microversion: 2.1 time: 0.150332 Jul 12 17:49:41.014070 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 556/1117] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:49:40 2022] GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:49:41.275337 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-6ca2d26e-fb2a-40fb-a810-907db52bf400 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:41.276113 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-6ca2d26e-fb2a-40fb-a810-907db52bf400 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: d360de38-a762-403b-bed3-d9ac43ffa09d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:41.284236 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6ca2d26e-fb2a-40fb-a810-907db52bf400 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:41.284799 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6ca2d26e-fb2a-40fb-a810-907db52bf400 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:41.285879 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6ca2d26e-fb2a-40fb-a810-907db52bf400 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:41.286393 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6ca2d26e-fb2a-40fb-a810-907db52bf400 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:41.327359 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6ca2d26e-fb2a-40fb-a810-907db52bf400 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:41.327808 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-6ca2d26e-fb2a-40fb-a810-907db52bf400 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:41.328258 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.objects.instance [None req-6ca2d26e-fb2a-40fb-a810-907db52bf400 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lazy-loading 'fault' on Instance uuid d360de38-a762-403b-bed3-d9ac43ffa09d {{(pid=130059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:49:41.371359 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-6ca2d26e-fb2a-40fb-a810-907db52bf400 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:49:41.379464 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-6ca2d26e-fb2a-40fb-a810-907db52bf400 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d" status: 200 len: 1229 microversion: 2.1 time: 0.108809 Jul 12 17:49:41.380103 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 562/1118] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:49:41 2022] GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d => generated 1229 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:49:42.034132 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-d498e574-ccbd-49dd-ab63-30adf1364b37 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:42.034132 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-d498e574-ccbd-49dd-ab63-30adf1364b37 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 5b6a76fc-e670-438a-af22-12a1772e5301] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:42.039495 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d498e574-ccbd-49dd-ab63-30adf1364b37 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:42.039956 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d498e574-ccbd-49dd-ab63-30adf1364b37 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:42.040867 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d498e574-ccbd-49dd-ab63-30adf1364b37 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:42.041314 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d498e574-ccbd-49dd-ab63-30adf1364b37 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:42.250985 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-d498e574-ccbd-49dd-ab63-30adf1364b37 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:49:42.259513 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-d498e574-ccbd-49dd-ab63-30adf1364b37 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301" status: 200 len: 1515 microversion: 2.1 time: 0.232238 Jul 12 17:49:42.260101 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 557/1119] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:49:42 2022] GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301 => generated 1515 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:49:42.405657 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-5681a80b-0c4b-49cd-9232-6c9247deecf6 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:42.405657 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-5681a80b-0c4b-49cd-9232-6c9247deecf6 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: d360de38-a762-403b-bed3-d9ac43ffa09d] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:42.411865 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5681a80b-0c4b-49cd-9232-6c9247deecf6 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:42.412324 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5681a80b-0c4b-49cd-9232-6c9247deecf6 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:42.413115 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5681a80b-0c4b-49cd-9232-6c9247deecf6 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:42.413558 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5681a80b-0c4b-49cd-9232-6c9247deecf6 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:42.428638 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-5681a80b-0c4b-49cd-9232-6c9247deecf6 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] HTTP exception thrown: Instance d360de38-a762-403b-bed3-d9ac43ffa09d could not be found. Jul 12 17:49:42.431914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-5681a80b-0c4b-49cd-9232-6c9247deecf6 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Request method failure captured: Jul 12 17:49:42.431914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d HTTP/1.1 Jul 12 17:49:42.431914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:49:42.431914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:49:42.431914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:49:42.431914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 0 Jul 12 17:49:42.431914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:49:42.431914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:49:42.431914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:49:42.431914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:49:42.431914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbI4GDLQtc2CxRqirHf0hryzzYqOjcXKT3uKi1BpUomxDXmpafZsj5L8QtMP8_U7R6LmXRVNwS9H_UotzsQ5ktQB0wL3vBc3dCLJ_BQik441Op6NQWj8TNT5rP2bZfLom9YVnx-jGBr2zGSzoLc53wjbLJObazT2tXG1TlhTYmdCREI Jul 12 17:49:42.431914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:49:42.431914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:49:42.431914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:49:42.431914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:49:42.431914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:49:42.431914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:49:42.431914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: e4b2b488b746454b9f93d67fa3c97809 Jul 12 17:49:42.431914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-TestVolumeBootPattern-1452615606 Jul 12 17:49:42.431914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:49:42.431914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:49:42.433586 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4b2b488b746454b9f93d67fa3c97809"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e4b2b488b746454b9f93d67fa3c97809", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4b2b488b746454b9f93d67fa3c97809"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e4b2b488b746454b9f93d67fa3c97809"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:49:42.433586 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-TestVolumeBootPattern-1452615606 Jul 12 17:49:42.433586 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: e4b2b488b746454b9f93d67fa3c97809 Jul 12 17:49:42.433586 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-TestVolumeBootPattern-1452615606 Jul 12 17:49:42.433586 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-TestVolumeBootPattern-1452615606-project Jul 12 17:49:42.433586 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:49:42.433586 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:49:42.433586 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: bde6ee9df10146d98991b0d4bb37fc48 Jul 12 17:49:42.433586 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-TestVolumeBootPattern-1452615606-project Jul 12 17:49:42.433586 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: > Jul 12 17:49:42.433586 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Instance d360de38-a762-403b-bed3-d9ac43ffa09d could not be found. Jul 12 17:49:42.433586 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'id': 'd360de38-a762-403b-bed3-d9ac43ffa09d'} Jul 12 17:49:42.434415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:49:42.434415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:49:42.434415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:49:42.434415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:49:42.434415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:49:42.434415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:49:42.434415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:49:42.434415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:49:42.434415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:49:42.434415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:49:42.434415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d360de38-a762-403b-bed3-d9ac43ffa09d could not be found. Jul 12 17:49:42.434415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:49:42.434415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:49:42.434415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:49:42.434415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:49:42.434415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:49:42.434415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:49:42.434415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:49:42.434415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:49:42.434415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:49:42.435842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:49:42.435842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:49:42.435842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:49:42.435842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:49:42.435842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:49:42.435842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:49:42.435842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:49:42.435842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d360de38-a762-403b-bed3-d9ac43ffa09d could not be found. Jul 12 17:49:42.435842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:49:42.435842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:49:42.435842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:49:42.435842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:49:42.435842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:49:42.435842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:49:42.435842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:49:42.435842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:49:42.435842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d360de38-a762-403b-bed3-d9ac43ffa09d could not be found. Jul 12 17:49:42.435842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:49:42.437048 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-5681a80b-0c4b-49cd-9232-6c9247deecf6 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Returning 404 to user: Instance d360de38-a762-403b-bed3-d9ac43ffa09d could not be found. {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:49:42.437048 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-5681a80b-0c4b-49cd-9232-6c9247deecf6 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d" status: 404 len: 111 microversion: 2.1 time: 0.036542 Jul 12 17:49:42.437048 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 563/1120] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:49:42 2022] GET /compute/v2.1/servers/d360de38-a762-403b-bed3-d9ac43ffa09d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:49:42.461514 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-e6c8b033-4807-4dba-977d-3ca2eebc0ef3 req-589debe0-ac09-4f66-8d3c-a4e5719d03c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b6a76fc-e670-438a-af22-12a1772e5301", "name": "network-vif-deleted", "tag": "0688383a-1589-4059-b874-e659acf36f0b"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:49:42.472363 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-e6c8b033-4807-4dba-977d-3ca2eebc0ef3 req-589debe0-ac09-4f66-8d3c-a4e5719d03c3 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:42.472818 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-e6c8b033-4807-4dba-977d-3ca2eebc0ef3 req-589debe0-ac09-4f66-8d3c-a4e5719d03c3 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:42.486096 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-e6c8b033-4807-4dba-977d-3ca2eebc0ef3 req-589debe0-ac09-4f66-8d3c-a4e5719d03c3 service nova] Creating event network-vif-deleted:0688383a-1589-4059-b874-e659acf36f0b for instance 5b6a76fc-e670-438a-af22-12a1772e5301 on hv-cinder-84875 Jul 12 17:49:42.491374 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-e6c8b033-4807-4dba-977d-3ca2eebc0ef3 req-589debe0-ac09-4f66-8d3c-a4e5719d03c3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033922 Jul 12 17:49:42.492015 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 558/1121] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:49:43.277594 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-bb475d70-963a-4b3f-bfc0-6b35bbb348b4 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:43.278215 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-bb475d70-963a-4b3f-bfc0-6b35bbb348b4 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 5b6a76fc-e670-438a-af22-12a1772e5301] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:43.284800 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bb475d70-963a-4b3f-bfc0-6b35bbb348b4 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:43.285255 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bb475d70-963a-4b3f-bfc0-6b35bbb348b4 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:43.286061 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bb475d70-963a-4b3f-bfc0-6b35bbb348b4 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:43.286537 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bb475d70-963a-4b3f-bfc0-6b35bbb348b4 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:43.319866 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bb475d70-963a-4b3f-bfc0-6b35bbb348b4 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:43.320317 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bb475d70-963a-4b3f-bfc0-6b35bbb348b4 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:43.320824 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.objects.instance [None req-bb475d70-963a-4b3f-bfc0-6b35bbb348b4 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lazy-loading 'fault' on Instance uuid 5b6a76fc-e670-438a-af22-12a1772e5301 {{(pid=130059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:49:43.362508 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-bb475d70-963a-4b3f-bfc0-6b35bbb348b4 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:49:43.369947 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-bb475d70-963a-4b3f-bfc0-6b35bbb348b4 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301" status: 200 len: 1309 microversion: 2.1 time: 0.096589 Jul 12 17:49:43.370565 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 564/1122] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:49:43 2022] GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301 => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:49:44.390098 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-ab650a66-23ef-4267-8970-57897040b9e1 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:44.390729 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-ab650a66-23ef-4267-8970-57897040b9e1 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 5b6a76fc-e670-438a-af22-12a1772e5301] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:44.397141 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ab650a66-23ef-4267-8970-57897040b9e1 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:44.397615 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ab650a66-23ef-4267-8970-57897040b9e1 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:44.398387 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ab650a66-23ef-4267-8970-57897040b9e1 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:44.398859 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ab650a66-23ef-4267-8970-57897040b9e1 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:44.412517 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.wsgi [None req-ab650a66-23ef-4267-8970-57897040b9e1 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] HTTP exception thrown: Instance 5b6a76fc-e670-438a-af22-12a1772e5301 could not be found. Jul 12 17:49:44.414184 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-ab650a66-23ef-4267-8970-57897040b9e1 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Request method failure captured: Jul 12 17:49:44.414184 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: request: GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301 HTTP/1.1 Jul 12 17:49:44.414184 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept: application/json Jul 12 17:49:44.414184 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept-Encoding: identity Jul 12 17:49:44.414184 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Connection: close Jul 12 17:49:44.414184 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Length: 0 Jul 12 17:49:44.414184 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Type: application/json Jul 12 17:49:44.414184 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Host: 10.222.0.16 Jul 12 17:49:44.414184 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Openstack-System-Scope: None Jul 12 17:49:44.414184 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: User-Agent: python-urllib3/1.26.9 Jul 12 17:49:44.414184 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Auth-Token: gAAAAABizbP1RCwUJu9Tr9YtmfVTMlo7vjyRHNZ-ygufifaRD8KTPBg87CrXYrhGkMJUvPMUEuo38UEPoFiw25-OFaAj0QegFjPBqVcIr1p-Rq5JW-L_q-pLMz3L0o1CSs1eIBvbYTJ_-jeTGLGOx-P7QLY33mCZRrqiNIQcMvFFIlPPpuIzASk Jul 12 17:49:44.414184 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Id: None Jul 12 17:49:44.414184 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Name: None Jul 12 17:49:44.414184 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Identity-Status: Confirmed Jul 12 17:49:44.414184 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Is-Admin-Project: True Jul 12 17:49:44.414184 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Id: default Jul 12 17:49:44.414184 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Name: Default Jul 12 17:49:44.414184 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Id: c3b0319262bc468d82fa3fba94540142 Jul 12 17:49:44.414184 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Name: tempest-VolumesSnapshotTestJSON-445542671 Jul 12 17:49:44.414184 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Role: reader,member Jul 12 17:49:44.414184 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Roles: reader,member Jul 12 17:49:44.416091 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c3b0319262bc468d82fa3fba94540142"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c3b0319262bc468d82fa3fba94540142", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c3b0319262bc468d82fa3fba94540142"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c3b0319262bc468d82fa3fba94540142"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:49:44.416091 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant: tempest-VolumesSnapshotTestJSON-445542671 Jul 12 17:49:44.416091 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Id: c3b0319262bc468d82fa3fba94540142 Jul 12 17:49:44.416091 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-445542671 Jul 12 17:49:44.416091 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User: tempest-VolumesSnapshotTestJSON-445542671-project Jul 12 17:49:44.416091 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Id: default Jul 12 17:49:44.416091 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Name: Default Jul 12 17:49:44.416091 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Id: 01d3c959a87247cd833db555fdef9af5 Jul 12 17:49:44.416091 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Name: tempest-VolumesSnapshotTestJSON-445542671-project Jul 12 17:49:44.416091 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: method: > Jul 12 17:49:44.416091 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: exception: Instance 5b6a76fc-e670-438a-af22-12a1772e5301 could not be found. Jul 12 17:49:44.416091 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: action_args: {'id': '5b6a76fc-e670-438a-af22-12a1772e5301'} Jul 12 17:49:44.417265 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:49:44.417265 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:49:44.417265 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:49:44.417265 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:49:44.417265 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:49:44.417265 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:49:44.417265 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:49:44.417265 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:49:44.417265 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:49:44.417265 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:49:44.417265 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b6a76fc-e670-438a-af22-12a1772e5301 could not be found. Jul 12 17:49:44.417265 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:49:44.417265 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:49:44.417265 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:49:44.417265 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:49:44.417265 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:49:44.417265 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:49:44.417265 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:49:44.417265 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:49:44.417265 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:49:44.418827 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:49:44.418827 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:49:44.418827 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:49:44.418827 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:49:44.418827 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:49:44.418827 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:49:44.418827 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:49:44.418827 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b6a76fc-e670-438a-af22-12a1772e5301 could not be found. Jul 12 17:49:44.418827 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:49:44.418827 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:49:44.418827 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:49:44.418827 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:49:44.418827 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:49:44.418827 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:49:44.418827 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:49:44.418827 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:49:44.418827 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b6a76fc-e670-438a-af22-12a1772e5301 could not be found. Jul 12 17:49:44.418827 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:49:44.420389 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-ab650a66-23ef-4267-8970-57897040b9e1 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Returning 404 to user: Instance 5b6a76fc-e670-438a-af22-12a1772e5301 could not be found. {{(pid=130058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:49:44.420389 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-ab650a66-23ef-4267-8970-57897040b9e1 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301" status: 404 len: 111 microversion: 2.1 time: 0.030527 Jul 12 17:49:44.420389 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 559/1123] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:49:44 2022] GET /compute/v2.1/servers/5b6a76fc-e670-438a-af22-12a1772e5301 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 17:49:45.857063 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-c069667d-0506-41e2-b932-38eb5122ea3e tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:45.857577 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-c069667d-0506-41e2-b932-38eb5122ea3e tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: ca00771c-f3e8-47de-aafc-9eb8a1a785b1] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:45.863715 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-818bebb5-581f-4e62-b244-014430debac2 req-0c2079b2-014d-49be-ac40-6d87621d5ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca00771c-f3e8-47de-aafc-9eb8a1a785b1", "tag": "78739528-de51-4c99-820c-5e39ced35a39"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:49:45.866127 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c069667d-0506-41e2-b932-38eb5122ea3e tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:45.866872 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c069667d-0506-41e2-b932-38eb5122ea3e tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:45.867871 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c069667d-0506-41e2-b932-38eb5122ea3e tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:45.868507 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c069667d-0506-41e2-b932-38eb5122ea3e tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:45.874909 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-818bebb5-581f-4e62-b244-014430debac2 req-0c2079b2-014d-49be-ac40-6d87621d5ca9 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:45.875860 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-818bebb5-581f-4e62-b244-014430debac2 req-0c2079b2-014d-49be-ac40-6d87621d5ca9 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:45.889272 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-818bebb5-581f-4e62-b244-014430debac2 req-0c2079b2-014d-49be-ac40-6d87621d5ca9 service nova] Creating event network-changed:78739528-de51-4c99-820c-5e39ced35a39 for instance ca00771c-f3e8-47de-aafc-9eb8a1a785b1 on hv-cinder-84875 Jul 12 17:49:45.898745 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-c069667d-0506-41e2-b932-38eb5122ea3e tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: ca00771c-f3e8-47de-aafc-9eb8a1a785b1] Going to try to terminate instance {{(pid=130059) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:49:45.900262 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-818bebb5-581f-4e62-b244-014430debac2 req-0c2079b2-014d-49be-ac40-6d87621d5ca9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043402 Jul 12 17:49:45.900836 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 560/1124] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:49:45.935178 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:49:46.239528 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-c069667d-0506-41e2-b932-38eb5122ea3e tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1" status: 204 len: 0 microversion: 2.1 time: 0.386336 Jul 12 17:49:46.240176 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 565/1125] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 12 17:49:45 2022] DELETE /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:49:46.252123 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-698a71c3-4b61-4dc5-a56b-11bd283df52a tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:46.252123 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-698a71c3-4b61-4dc5-a56b-11bd283df52a tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: ca00771c-f3e8-47de-aafc-9eb8a1a785b1] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:46.258871 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-698a71c3-4b61-4dc5-a56b-11bd283df52a tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:46.259334 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-698a71c3-4b61-4dc5-a56b-11bd283df52a tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:46.260117 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-698a71c3-4b61-4dc5-a56b-11bd283df52a tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:46.260730 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-698a71c3-4b61-4dc5-a56b-11bd283df52a tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:46.397329 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-698a71c3-4b61-4dc5-a56b-11bd283df52a tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:49:46.404896 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-698a71c3-4b61-4dc5-a56b-11bd283df52a tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1" status: 200 len: 1577 microversion: 2.1 time: 0.160172 Jul 12 17:49:46.405464 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 561/1126] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:49:46 2022] GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:49:47.423204 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-f1683666-7f1e-494f-aa1a-6ffe78052fb2 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:47.424499 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-f1683666-7f1e-494f-aa1a-6ffe78052fb2 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: ca00771c-f3e8-47de-aafc-9eb8a1a785b1] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:47.431124 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f1683666-7f1e-494f-aa1a-6ffe78052fb2 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:47.431579 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f1683666-7f1e-494f-aa1a-6ffe78052fb2 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:47.432355 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f1683666-7f1e-494f-aa1a-6ffe78052fb2 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:47.432800 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f1683666-7f1e-494f-aa1a-6ffe78052fb2 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:47.566821 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-f1683666-7f1e-494f-aa1a-6ffe78052fb2 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:49:47.574771 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-f1683666-7f1e-494f-aa1a-6ffe78052fb2 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1" status: 200 len: 1577 microversion: 2.1 time: 0.155740 Jul 12 17:49:47.575360 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 566/1127] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:49:47 2022] GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:49:48.591303 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-be59428f-8d74-4486-b25a-cc97af2d8ebf tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:48.591929 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-be59428f-8d74-4486-b25a-cc97af2d8ebf tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: ca00771c-f3e8-47de-aafc-9eb8a1a785b1] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:48.598326 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-be59428f-8d74-4486-b25a-cc97af2d8ebf tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:48.599276 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-be59428f-8d74-4486-b25a-cc97af2d8ebf tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:48.599609 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-be59428f-8d74-4486-b25a-cc97af2d8ebf tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:48.600048 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-be59428f-8d74-4486-b25a-cc97af2d8ebf tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:48.733416 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-be59428f-8d74-4486-b25a-cc97af2d8ebf tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:49:48.741794 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-be59428f-8d74-4486-b25a-cc97af2d8ebf tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1" status: 200 len: 1577 microversion: 2.1 time: 0.154500 Jul 12 17:49:48.742354 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 562/1128] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:49:48 2022] GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:49:49.760343 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-cc144617-e613-4347-b270-958f40730a60 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:49.760993 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-cc144617-e613-4347-b270-958f40730a60 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: ca00771c-f3e8-47de-aafc-9eb8a1a785b1] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:49.770626 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cc144617-e613-4347-b270-958f40730a60 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:49.771085 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cc144617-e613-4347-b270-958f40730a60 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:49.771985 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cc144617-e613-4347-b270-958f40730a60 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:49.772437 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cc144617-e613-4347-b270-958f40730a60 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:49.917984 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-cc144617-e613-4347-b270-958f40730a60 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:49:49.926544 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-cc144617-e613-4347-b270-958f40730a60 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1" status: 200 len: 1577 microversion: 2.1 time: 0.170075 Jul 12 17:49:49.927157 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 567/1129] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:49:49 2022] GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1 => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:49:50.588665 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-e57c3c78-6b07-45fb-8c93-6b43d1ed5531 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:50.590078 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-e57c3c78-6b07-45fb-8c93-6b43d1ed5531 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:50.597047 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e57c3c78-6b07-45fb-8c93-6b43d1ed5531 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:50.597614 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e57c3c78-6b07-45fb-8c93-6b43d1ed5531 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:50.598848 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e57c3c78-6b07-45fb-8c93-6b43d1ed5531 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:50.599390 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e57c3c78-6b07-45fb-8c93-6b43d1ed5531 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:50.633360 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-e57c3c78-6b07-45fb-8c93-6b43d1ed5531 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047804 Jul 12 17:49:50.633948 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 563/1130] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:49:50 2022] GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:49:50.786425 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-b16d44c4-dcc0-48c2-bd0e-1d7fe1b2a1c6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:50.786425 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-b16d44c4-dcc0-48c2-bd0e-1d7fe1b2a1c6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:50.791684 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b16d44c4-dcc0-48c2-bd0e-1d7fe1b2a1c6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:50.792144 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b16d44c4-dcc0-48c2-bd0e-1d7fe1b2a1c6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:50.792982 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b16d44c4-dcc0-48c2-bd0e-1d7fe1b2a1c6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:50.793431 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-b16d44c4-dcc0-48c2-bd0e-1d7fe1b2a1c6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:50.831191 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-b16d44c4-dcc0-48c2-bd0e-1d7fe1b2a1c6 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435/os-volume_attachments/b2b469dc-74e9-4561-9d4f-b49b55cdc09a" status: 200 len: 194 microversion: 2.1 time: 0.051843 Jul 12 17:49:50.831357 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 568/1131] 10.222.0.16 () {58 vars in 1412 bytes} [Tue Jul 12 17:49:50 2022] GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435/os-volume_attachments/b2b469dc-74e9-4561-9d4f-b49b55cdc09a => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:49:50.840946 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-31e4c065-bc32-40fd-8f13-245bec800b85 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:50.841592 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-31e4c065-bc32-40fd-8f13-245bec800b85 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:50.849193 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-31e4c065-bc32-40fd-8f13-245bec800b85 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:50.849606 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-31e4c065-bc32-40fd-8f13-245bec800b85 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:50.850374 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-31e4c065-bc32-40fd-8f13-245bec800b85 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:50.850850 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-31e4c065-bc32-40fd-8f13-245bec800b85 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:50.904977 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-54ee6997-ff1f-48c0-b665-160bf7922f70 req-583fc4db-6440-4bb6-9c05-6fc2c9f1d20c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca00771c-f3e8-47de-aafc-9eb8a1a785b1", "name": "network-vif-deleted", "tag": "78739528-de51-4c99-820c-5e39ced35a39"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:49:50.913438 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-54ee6997-ff1f-48c0-b665-160bf7922f70 req-583fc4db-6440-4bb6-9c05-6fc2c9f1d20c service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:50.913925 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-54ee6997-ff1f-48c0-b665-160bf7922f70 req-583fc4db-6440-4bb6-9c05-6fc2c9f1d20c service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:50.928493 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-54ee6997-ff1f-48c0-b665-160bf7922f70 req-583fc4db-6440-4bb6-9c05-6fc2c9f1d20c service nova] Creating event network-vif-deleted:78739528-de51-4c99-820c-5e39ced35a39 for instance ca00771c-f3e8-47de-aafc-9eb8a1a785b1 on hv-cinder-84875 Jul 12 17:49:50.936842 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-54ee6997-ff1f-48c0-b665-160bf7922f70 req-583fc4db-6440-4bb6-9c05-6fc2c9f1d20c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095379 Jul 12 17:49:50.937944 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 569/1132] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:49:50.940172 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.objects.instance [None req-31e4c065-bc32-40fd-8f13-245bec800b85 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lazy-loading 'services' on Instance uuid 8980ef12-e677-4a55-b5dc-e1c27b4fb435 {{(pid=130058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:49:50.947650 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-4324cbf1-2d8d-4d95-8a2d-91056dad5a50 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:50.951254 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-4324cbf1-2d8d-4d95-8a2d-91056dad5a50 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: ca00771c-f3e8-47de-aafc-9eb8a1a785b1] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:50.955014 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4324cbf1-2d8d-4d95-8a2d-91056dad5a50 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:50.955468 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4324cbf1-2d8d-4d95-8a2d-91056dad5a50 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:50.956315 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4324cbf1-2d8d-4d95-8a2d-91056dad5a50 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:50.956810 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-4324cbf1-2d8d-4d95-8a2d-91056dad5a50 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:51.021948 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-4324cbf1-2d8d-4d95-8a2d-91056dad5a50 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:49:51.029680 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-4324cbf1-2d8d-4d95-8a2d-91056dad5a50 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1" status: 200 len: 1392 microversion: 2.1 time: 0.086253 Jul 12 17:49:51.032467 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 570/1133] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:49:50 2022] GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1 => generated 1392 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:49:51.204926 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-31e4c065-bc32-40fd-8f13-245bec800b85 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435/os-volume_attachments/b2b469dc-74e9-4561-9d4f-b49b55cdc09a" status: 202 len: 0 microversion: 2.1 time: 0.367586 Jul 12 17:49:51.206113 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 564/1134] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jul 12 17:49:50 2022] DELETE /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435/os-volume_attachments/b2b469dc-74e9-4561-9d4f-b49b55cdc09a => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:49:52.047526 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-e3ae69c5-15c8-4fd7-a282-39e9f3ff3fac tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:52.048136 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-e3ae69c5-15c8-4fd7-a282-39e9f3ff3fac tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: ca00771c-f3e8-47de-aafc-9eb8a1a785b1] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:52.054775 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e3ae69c5-15c8-4fd7-a282-39e9f3ff3fac tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:52.055232 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e3ae69c5-15c8-4fd7-a282-39e9f3ff3fac tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:52.056001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e3ae69c5-15c8-4fd7-a282-39e9f3ff3fac tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:52.056442 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e3ae69c5-15c8-4fd7-a282-39e9f3ff3fac tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:52.118864 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-e3ae69c5-15c8-4fd7-a282-39e9f3ff3fac tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:49:52.126323 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-e3ae69c5-15c8-4fd7-a282-39e9f3ff3fac tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1" status: 200 len: 1225 microversion: 2.1 time: 0.082774 Jul 12 17:49:52.126921 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 571/1135] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:49:52 2022] GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:49:53.200250 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-ebcd31c3-f49b-4daa-b32c-343f7223489d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:53.200917 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-ebcd31c3-f49b-4daa-b32c-343f7223489d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: ca00771c-f3e8-47de-aafc-9eb8a1a785b1] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:53.208450 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ebcd31c3-f49b-4daa-b32c-343f7223489d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:53.208899 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ebcd31c3-f49b-4daa-b32c-343f7223489d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:53.209668 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ebcd31c3-f49b-4daa-b32c-343f7223489d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:53.210104 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ebcd31c3-f49b-4daa-b32c-343f7223489d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:53.274769 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ebcd31c3-f49b-4daa-b32c-343f7223489d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:49:53.282627 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-ebcd31c3-f49b-4daa-b32c-343f7223489d tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1" status: 200 len: 1225 microversion: 2.1 time: 0.086850 Jul 12 17:49:53.283192 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 565/1136] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:49:53 2022] GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:49:54.300542 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-e388535c-4e8e-44a0-b7b5-618630ad7de7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:54.301171 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-e388535c-4e8e-44a0-b7b5-618630ad7de7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: ca00771c-f3e8-47de-aafc-9eb8a1a785b1] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:54.307812 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e388535c-4e8e-44a0-b7b5-618630ad7de7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:54.308262 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e388535c-4e8e-44a0-b7b5-618630ad7de7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:54.309032 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e388535c-4e8e-44a0-b7b5-618630ad7de7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:54.309464 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e388535c-4e8e-44a0-b7b5-618630ad7de7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:54.340725 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e388535c-4e8e-44a0-b7b5-618630ad7de7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:54.341179 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e388535c-4e8e-44a0-b7b5-618630ad7de7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:54.341640 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.objects.instance [None req-e388535c-4e8e-44a0-b7b5-618630ad7de7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lazy-loading 'fault' on Instance uuid ca00771c-f3e8-47de-aafc-9eb8a1a785b1 {{(pid=130059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:49:54.388466 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-e388535c-4e8e-44a0-b7b5-618630ad7de7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bde6ee9df10146d98991b0d4bb37fc48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b2b488b746454b9f93d67fa3c97809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:49:54.397189 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-e388535c-4e8e-44a0-b7b5-618630ad7de7 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1" status: 200 len: 1230 microversion: 2.1 time: 0.101365 Jul 12 17:49:54.397992 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 572/1137] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:49:54 2022] GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1 => generated 1230 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:49:54.905777 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-c9a4c142-b2b9-480f-8116-d1181a466a61 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-150308715", "imageRef": "cb077f42-97cd-41cf-8758-764c562534f4", "flavorRef": "452", "networks": [{"uuid": "59cc3c4a-a236-4992-93d9-af42c67d0a53"}]}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:49:54.963482 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.network.neutron [None req-c9a4c142-b2b9-480f-8116-d1181a466a61 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] validate_networks() for [('59cc3c4a-a236-4992-93d9-af42c67d0a53', None, None, None, None, None)] {{(pid=130058) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:49:55.332056 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-c9a4c142-b2b9-480f-8116-d1181a466a61 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Flavor limits 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:49:55.332479 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-c9a4c142-b2b9-480f-8116-d1181a466a61 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Image limits 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:49:55.332965 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-c9a4c142-b2b9-480f-8116-d1181a466a61 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Flavor pref 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:49:55.333367 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-c9a4c142-b2b9-480f-8116-d1181a466a61 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Image pref 0:0:0 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:49:55.333771 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.virt.hardware [None req-c9a4c142-b2b9-480f-8116-d1181a466a61 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130058) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:49:55.342561 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c9a4c142-b2b9-480f-8116-d1181a466a61 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:55.342941 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c9a4c142-b2b9-480f-8116-d1181a466a61 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:55.343754 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c9a4c142-b2b9-480f-8116-d1181a466a61 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:55.344188 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-c9a4c142-b2b9-480f-8116-d1181a466a61 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:55.360931 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-c9a4c142-b2b9-480f-8116-d1181a466a61 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Getting quotas for project c3b0319262bc468d82fa3fba94540142. Resources: {'cores', 'instances', 'ram'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:49:55.365389 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-c9a4c142-b2b9-480f-8116-d1181a466a61 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Getting quotas for user 01d3c959a87247cd833db555fdef9af5 and project c3b0319262bc468d82fa3fba94540142. Resources: {'cores', 'instances', 'ram'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:49:55.376053 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-c9a4c142-b2b9-480f-8116-d1181a466a61 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Going to run 1 instances... {{(pid=130058) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:49:55.378328 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-c9a4c142-b2b9-480f-8116-d1181a466a61 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 89e0c5bc-485b-4baa-ae1f-872099e94913] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb077f42-97cd-41cf-8758-764c562534f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130058) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:49:55.414732 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-cb4a216b-e65f-417f-a265-25b9c1b40f12 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:55.415352 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-cb4a216b-e65f-417f-a265-25b9c1b40f12 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: ca00771c-f3e8-47de-aafc-9eb8a1a785b1] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:55.421828 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cb4a216b-e65f-417f-a265-25b9c1b40f12 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:55.422285 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cb4a216b-e65f-417f-a265-25b9c1b40f12 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:55.423123 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cb4a216b-e65f-417f-a265-25b9c1b40f12 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:55.423570 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-cb4a216b-e65f-417f-a265-25b9c1b40f12 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:55.438366 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-cb4a216b-e65f-417f-a265-25b9c1b40f12 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] HTTP exception thrown: Instance ca00771c-f3e8-47de-aafc-9eb8a1a785b1 could not be found. Jul 12 17:49:55.440194 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-cb4a216b-e65f-417f-a265-25b9c1b40f12 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Request method failure captured: Jul 12 17:49:55.440194 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1 HTTP/1.1 Jul 12 17:49:55.440194 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:49:55.440194 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:49:55.440194 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:49:55.440194 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 0 Jul 12 17:49:55.440194 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:49:55.440194 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:49:55.440194 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:49:55.440194 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:49:55.440194 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbI4GDLQtc2CxRqirHf0hryzzYqOjcXKT3uKi1BpUomxDXmpafZsj5L8QtMP8_U7R6LmXRVNwS9H_UotzsQ5ktQB0wL3vBc3dCLJ_BQik441Op6NQWj8TNT5rP2bZfLom9YVnx-jGBr2zGSzoLc53wjbLJObazT2tXG1TlhTYmdCREI Jul 12 17:49:55.440194 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:49:55.440194 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:49:55.440194 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:49:55.440194 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:49:55.440194 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:49:55.440194 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:49:55.440194 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: e4b2b488b746454b9f93d67fa3c97809 Jul 12 17:49:55.440194 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-TestVolumeBootPattern-1452615606 Jul 12 17:49:55.440194 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:49:55.440194 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:49:55.442248 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4b2b488b746454b9f93d67fa3c97809"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e4b2b488b746454b9f93d67fa3c97809", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4b2b488b746454b9f93d67fa3c97809"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e4b2b488b746454b9f93d67fa3c97809"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:49:55.442248 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-TestVolumeBootPattern-1452615606 Jul 12 17:49:55.442248 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: e4b2b488b746454b9f93d67fa3c97809 Jul 12 17:49:55.442248 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-TestVolumeBootPattern-1452615606 Jul 12 17:49:55.442248 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-TestVolumeBootPattern-1452615606-project Jul 12 17:49:55.442248 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:49:55.442248 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:49:55.442248 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: bde6ee9df10146d98991b0d4bb37fc48 Jul 12 17:49:55.442248 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-TestVolumeBootPattern-1452615606-project Jul 12 17:49:55.442248 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: > Jul 12 17:49:55.442248 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Instance ca00771c-f3e8-47de-aafc-9eb8a1a785b1 could not be found. Jul 12 17:49:55.442248 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'id': 'ca00771c-f3e8-47de-aafc-9eb8a1a785b1'} Jul 12 17:49:55.443243 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:49:55.443243 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:49:55.443243 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:49:55.443243 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:49:55.443243 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:49:55.443243 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:49:55.443243 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:49:55.443243 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:49:55.443243 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:49:55.443243 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:49:55.443243 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca00771c-f3e8-47de-aafc-9eb8a1a785b1 could not be found. Jul 12 17:49:55.443243 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:49:55.443243 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:49:55.443243 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:49:55.443243 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:49:55.443243 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:49:55.443243 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:49:55.443243 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:49:55.443243 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:49:55.443243 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:49:55.444834 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:49:55.444834 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:49:55.444834 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:49:55.444834 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:49:55.444834 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:49:55.444834 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:49:55.444834 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:49:55.444834 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca00771c-f3e8-47de-aafc-9eb8a1a785b1 could not be found. Jul 12 17:49:55.444834 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:49:55.444834 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:49:55.444834 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:49:55.444834 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:49:55.444834 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:49:55.444834 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:49:55.444834 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:49:55.444834 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:49:55.444834 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca00771c-f3e8-47de-aafc-9eb8a1a785b1 could not be found. Jul 12 17:49:55.444834 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:49:55.446052 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-cb4a216b-e65f-417f-a265-25b9c1b40f12 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Returning 404 to user: Instance ca00771c-f3e8-47de-aafc-9eb8a1a785b1 could not be found. {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:49:55.446052 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-cb4a216b-e65f-417f-a265-25b9c1b40f12 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1" status: 404 len: 111 microversion: 2.1 time: 0.032067 Jul 12 17:49:55.446052 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 573/1138] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:49:55 2022] GET /compute/v2.1/servers/ca00771c-f3e8-47de-aafc-9eb8a1a785b1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 17:49:55.487595 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-76925edd-02da-46ee-9859-dfab21625527 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:55.488336 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-76925edd-02da-46ee-9859-dfab21625527 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:55.494692 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-76925edd-02da-46ee-9859-dfab21625527 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:55.495156 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-76925edd-02da-46ee-9859-dfab21625527 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:55.510026 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-76925edd-02da-46ee-9859-dfab21625527 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:55.510026 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-76925edd-02da-46ee-9859-dfab21625527 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:55.510288 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-c9a4c142-b2b9-480f-8116-d1181a466a61 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599611 Jul 12 17:49:55.510288 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 566/1139] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 12 17:49:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:49:55.521402 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-9731a0cb-66d6-4c15-a3a8-a04f00145b92 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:55.522326 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-9731a0cb-66d6-4c15-a3a8-a04f00145b92 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 89e0c5bc-485b-4baa-ae1f-872099e94913] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:55.528433 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-76925edd-02da-46ee-9859-dfab21625527 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435/os-volume_attachments/6a6f9c73-65af-4ad2-9443-14becdc5f52e" status: 200 len: 194 microversion: 2.1 time: 0.044784 Jul 12 17:49:55.534042 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 574/1140] 10.222.0.16 () {58 vars in 1412 bytes} [Tue Jul 12 17:49:55 2022] GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435/os-volume_attachments/6a6f9c73-65af-4ad2-9443-14becdc5f52e => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:49:55.539307 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-be6e535d-3556-4c80-8829-976bfda6c3f8 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:55.539811 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-be6e535d-3556-4c80-8829-976bfda6c3f8 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:55.546295 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-be6e535d-3556-4c80-8829-976bfda6c3f8 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:55.546791 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-be6e535d-3556-4c80-8829-976bfda6c3f8 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:55.547581 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-be6e535d-3556-4c80-8829-976bfda6c3f8 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:55.548028 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-be6e535d-3556-4c80-8829-976bfda6c3f8 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:55.593962 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-9731a0cb-66d6-4c15-a3a8-a04f00145b92 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:49:55.600793 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-9731a0cb-66d6-4c15-a3a8-a04f00145b92 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913" status: 200 len: 1218 microversion: 2.1 time: 0.085584 Jul 12 17:49:55.609989 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 567/1141] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:49:55 2022] GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:49:55.642943 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.objects.instance [None req-be6e535d-3556-4c80-8829-976bfda6c3f8 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lazy-loading 'services' on Instance uuid 8980ef12-e677-4a55-b5dc-e1c27b4fb435 {{(pid=130059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:49:55.872512 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-be6e535d-3556-4c80-8829-976bfda6c3f8 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435/os-volume_attachments/6a6f9c73-65af-4ad2-9443-14becdc5f52e" status: 202 len: 0 microversion: 2.1 time: 0.337043 Jul 12 17:49:55.873102 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 575/1142] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jul 12 17:49:55 2022] DELETE /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435/os-volume_attachments/6a6f9c73-65af-4ad2-9443-14becdc5f52e => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:49:56.045163 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-2580805b-975d-4522-9486-4b24f7f161e0 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:56.045901 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-2580805b-975d-4522-9486-4b24f7f161e0 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:56.053182 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2580805b-975d-4522-9486-4b24f7f161e0 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:56.054394 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2580805b-975d-4522-9486-4b24f7f161e0 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:56.054394 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2580805b-975d-4522-9486-4b24f7f161e0 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:56.054831 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2580805b-975d-4522-9486-4b24f7f161e0 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:56.068764 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.wsgi [None req-2580805b-975d-4522-9486-4b24f7f161e0 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] HTTP exception thrown: Instance 73d03675-d5c4-4778-a9c2-320d010588b7 could not be found. Jul 12 17:49:56.070526 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-2580805b-975d-4522-9486-4b24f7f161e0 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Request method failure captured: Jul 12 17:49:56.070526 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: request: DELETE /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 HTTP/1.1 Jul 12 17:49:56.070526 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept: application/json Jul 12 17:49:56.070526 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept-Encoding: identity Jul 12 17:49:56.070526 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Connection: close Jul 12 17:49:56.070526 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Length: 0 Jul 12 17:49:56.070526 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Type: application/json Jul 12 17:49:56.070526 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Host: 10.222.0.16 Jul 12 17:49:56.070526 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Openstack-System-Scope: None Jul 12 17:49:56.070526 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: User-Agent: python-urllib3/1.26.9 Jul 12 17:49:56.070526 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Auth-Token: gAAAAABizbI4GDLQtc2CxRqirHf0hryzzYqOjcXKT3uKi1BpUomxDXmpafZsj5L8QtMP8_U7R6LmXRVNwS9H_UotzsQ5ktQB0wL3vBc3dCLJ_BQik441Op6NQWj8TNT5rP2bZfLom9YVnx-jGBr2zGSzoLc53wjbLJObazT2tXG1TlhTYmdCREI Jul 12 17:49:56.070526 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Id: None Jul 12 17:49:56.070526 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Name: None Jul 12 17:49:56.070526 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Identity-Status: Confirmed Jul 12 17:49:56.070526 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Is-Admin-Project: True Jul 12 17:49:56.070526 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Id: default Jul 12 17:49:56.070526 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Name: Default Jul 12 17:49:56.070526 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Id: e4b2b488b746454b9f93d67fa3c97809 Jul 12 17:49:56.070526 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Name: tempest-TestVolumeBootPattern-1452615606 Jul 12 17:49:56.070526 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Role: reader,member Jul 12 17:49:56.070526 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Roles: reader,member Jul 12 17:49:56.072161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4b2b488b746454b9f93d67fa3c97809"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e4b2b488b746454b9f93d67fa3c97809", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4b2b488b746454b9f93d67fa3c97809"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e4b2b488b746454b9f93d67fa3c97809"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:49:56.072161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant: tempest-TestVolumeBootPattern-1452615606 Jul 12 17:49:56.072161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Id: e4b2b488b746454b9f93d67fa3c97809 Jul 12 17:49:56.072161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Name: tempest-TestVolumeBootPattern-1452615606 Jul 12 17:49:56.072161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User: tempest-TestVolumeBootPattern-1452615606-project Jul 12 17:49:56.072161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Id: default Jul 12 17:49:56.072161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Name: Default Jul 12 17:49:56.072161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Id: bde6ee9df10146d98991b0d4bb37fc48 Jul 12 17:49:56.072161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Name: tempest-TestVolumeBootPattern-1452615606-project Jul 12 17:49:56.072161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: method: > Jul 12 17:49:56.072161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: exception: Instance 73d03675-d5c4-4778-a9c2-320d010588b7 could not be found. Jul 12 17:49:56.072161 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: action_args: {'id': '73d03675-d5c4-4778-a9c2-320d010588b7'} Jul 12 17:49:56.073011 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:49:56.073011 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:49:56.073011 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:49:56.073011 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:49:56.073011 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:49:56.073011 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:49:56.073011 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:49:56.073011 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:49:56.073011 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:49:56.073011 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:49:56.073011 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73d03675-d5c4-4778-a9c2-320d010588b7 could not be found. Jul 12 17:49:56.073011 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:49:56.073011 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:49:56.073011 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:49:56.073011 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:49:56.073011 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:49:56.073011 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:49:56.073011 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:49:56.073011 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:49:56.073011 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:49:56.074382 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:49:56.074382 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 17:49:56.074382 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 17:49:56.074382 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 17:49:56.074382 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 17:49:56.074382 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:49:56.074382 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:49:56.074382 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:49:56.074382 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:49:56.074382 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73d03675-d5c4-4778-a9c2-320d010588b7 could not be found. Jul 12 17:49:56.074382 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:49:56.074382 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:49:56.074382 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:49:56.074382 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:49:56.074382 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:49:56.074382 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:49:56.074382 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:49:56.074382 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:49:56.074382 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73d03675-d5c4-4778-a9c2-320d010588b7 could not be found. Jul 12 17:49:56.074382 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:49:56.081019 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-2580805b-975d-4522-9486-4b24f7f161e0 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Returning 404 to user: Instance 73d03675-d5c4-4778-a9c2-320d010588b7 could not be found. {{(pid=130058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:49:56.081019 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-2580805b-975d-4522-9486-4b24f7f161e0 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "DELETE /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 404 len: 111 microversion: 2.1 time: 0.030698 Jul 12 17:49:56.081019 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 568/1143] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 12 17:49:56 2022] DELETE /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:49:56.081835 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-c20f3810-3ace-4995-a9a9-52048b59efe4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:56.082572 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-c20f3810-3ace-4995-a9a9-52048b59efe4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] [instance: 73d03675-d5c4-4778-a9c2-320d010588b7] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:56.088899 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c20f3810-3ace-4995-a9a9-52048b59efe4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:56.089352 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c20f3810-3ace-4995-a9a9-52048b59efe4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:56.090124 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c20f3810-3ace-4995-a9a9-52048b59efe4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:56.090598 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c20f3810-3ace-4995-a9a9-52048b59efe4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:56.106141 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-c20f3810-3ace-4995-a9a9-52048b59efe4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] HTTP exception thrown: Instance 73d03675-d5c4-4778-a9c2-320d010588b7 could not be found. Jul 12 17:49:56.108088 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-c20f3810-3ace-4995-a9a9-52048b59efe4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Request method failure captured: Jul 12 17:49:56.108088 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 HTTP/1.1 Jul 12 17:49:56.108088 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:49:56.108088 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:49:56.108088 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:49:56.108088 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 0 Jul 12 17:49:56.108088 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:49:56.108088 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:49:56.108088 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:49:56.108088 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:49:56.108088 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbI4GDLQtc2CxRqirHf0hryzzYqOjcXKT3uKi1BpUomxDXmpafZsj5L8QtMP8_U7R6LmXRVNwS9H_UotzsQ5ktQB0wL3vBc3dCLJ_BQik441Op6NQWj8TNT5rP2bZfLom9YVnx-jGBr2zGSzoLc53wjbLJObazT2tXG1TlhTYmdCREI Jul 12 17:49:56.108088 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:49:56.108088 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:49:56.108088 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:49:56.108088 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:49:56.108088 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:49:56.108088 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:49:56.108088 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: e4b2b488b746454b9f93d67fa3c97809 Jul 12 17:49:56.108088 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-TestVolumeBootPattern-1452615606 Jul 12 17:49:56.108088 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:49:56.108088 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:49:56.110354 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4b2b488b746454b9f93d67fa3c97809"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e4b2b488b746454b9f93d67fa3c97809", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4b2b488b746454b9f93d67fa3c97809"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e4b2b488b746454b9f93d67fa3c97809"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:49:56.110354 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-TestVolumeBootPattern-1452615606 Jul 12 17:49:56.110354 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: e4b2b488b746454b9f93d67fa3c97809 Jul 12 17:49:56.110354 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-TestVolumeBootPattern-1452615606 Jul 12 17:49:56.110354 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-TestVolumeBootPattern-1452615606-project Jul 12 17:49:56.110354 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:49:56.110354 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:49:56.110354 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: bde6ee9df10146d98991b0d4bb37fc48 Jul 12 17:49:56.110354 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-TestVolumeBootPattern-1452615606-project Jul 12 17:49:56.110354 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: > Jul 12 17:49:56.110354 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Instance 73d03675-d5c4-4778-a9c2-320d010588b7 could not be found. Jul 12 17:49:56.110354 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'id': '73d03675-d5c4-4778-a9c2-320d010588b7'} Jul 12 17:49:56.111291 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:49:56.111291 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:49:56.111291 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:49:56.111291 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:49:56.111291 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:49:56.111291 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:49:56.111291 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:49:56.111291 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:49:56.111291 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:49:56.111291 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:49:56.111291 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73d03675-d5c4-4778-a9c2-320d010588b7 could not be found. Jul 12 17:49:56.111291 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:49:56.111291 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:49:56.111291 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:49:56.111291 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:49:56.111291 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:49:56.111291 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:49:56.111291 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:49:56.111291 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:49:56.111291 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:49:56.113124 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:49:56.113124 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:49:56.113124 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:49:56.113124 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:49:56.113124 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:49:56.113124 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:49:56.113124 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:49:56.113124 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73d03675-d5c4-4778-a9c2-320d010588b7 could not be found. Jul 12 17:49:56.113124 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:49:56.113124 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:49:56.113124 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:49:56.113124 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:49:56.113124 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:49:56.113124 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:49:56.113124 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:49:56.113124 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:49:56.113124 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73d03675-d5c4-4778-a9c2-320d010588b7 could not be found. Jul 12 17:49:56.113124 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:49:56.114491 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-c20f3810-3ace-4995-a9a9-52048b59efe4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Returning 404 to user: Instance 73d03675-d5c4-4778-a9c2-320d010588b7 could not be found. {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:49:56.114491 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-c20f3810-3ace-4995-a9a9-52048b59efe4 tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7" status: 404 len: 111 microversion: 2.1 time: 0.032973 Jul 12 17:49:56.114491 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 576/1144] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:49:56 2022] GET /compute/v2.1/servers/73d03675-d5c4-4778-a9c2-320d010588b7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:49:56.618103 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-6fc643c9-0e67-4e8a-a08f-4f9bb03944ae tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:56.618783 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-6fc643c9-0e67-4e8a-a08f-4f9bb03944ae tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 89e0c5bc-485b-4baa-ae1f-872099e94913] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:56.625105 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6fc643c9-0e67-4e8a-a08f-4f9bb03944ae tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:56.625799 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6fc643c9-0e67-4e8a-a08f-4f9bb03944ae tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:56.626611 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6fc643c9-0e67-4e8a-a08f-4f9bb03944ae tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:56.627107 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6fc643c9-0e67-4e8a-a08f-4f9bb03944ae tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:56.690281 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-6fc643c9-0e67-4e8a-a08f-4f9bb03944ae tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:49:56.698556 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-6fc643c9-0e67-4e8a-a08f-4f9bb03944ae tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913" status: 200 len: 1222 microversion: 2.1 time: 0.084174 Jul 12 17:49:56.699136 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 569/1145] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:49:56 2022] GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:49:57.641840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-df93c87a-9087-4efd-9986-24b40cdafe8f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] Calling method '.version_select at 0x7f479fe76ca0>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:57.716249 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-ba98d172-09bd-447e-89c7-a72ab4659853 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:57.716891 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-ba98d172-09bd-447e-89c7-a72ab4659853 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 89e0c5bc-485b-4baa-ae1f-872099e94913] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:57.723796 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-df93c87a-9087-4efd-9986-24b40cdafe8f tempest-TestVolumeBootPattern-1452615606 tempest-TestVolumeBootPattern-1452615606-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1463826168" status: 202 len: 0 microversion: 2.1 time: 0.085748 Jul 12 17:49:57.724515 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 577/1146] 10.222.0.16 () {58 vars in 1262 bytes} [Tue Jul 12 17:49:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1463826168 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:49:57.730396 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ba98d172-09bd-447e-89c7-a72ab4659853 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:57.730396 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ba98d172-09bd-447e-89c7-a72ab4659853 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:57.736957 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ba98d172-09bd-447e-89c7-a72ab4659853 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:57.737554 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ba98d172-09bd-447e-89c7-a72ab4659853 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:57.744901 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:49:57.824492 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ba98d172-09bd-447e-89c7-a72ab4659853 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:49:57.833112 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-ba98d172-09bd-447e-89c7-a72ab4659853 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913" status: 200 len: 1278 microversion: 2.1 time: 0.120686 Jul 12 17:49:57.833979 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 570/1147] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:49:57 2022] GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913 => generated 1278 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:49:58.110783 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-1130a8c7-6c6b-4182-a21a-eee6561c15b7 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:58.111737 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-1130a8c7-6c6b-4182-a21a-eee6561c15b7 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:58.119420 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1130a8c7-6c6b-4182-a21a-eee6561c15b7 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:58.121289 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1130a8c7-6c6b-4182-a21a-eee6561c15b7 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:58.121289 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1130a8c7-6c6b-4182-a21a-eee6561c15b7 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:58.121289 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1130a8c7-6c6b-4182-a21a-eee6561c15b7 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:58.159233 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-1130a8c7-6c6b-4182-a21a-eee6561c15b7 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052562 Jul 12 17:49:58.160204 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 578/1148] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:49:58 2022] GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 17:49:58.276022 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-82e1524b-ceb5-4508-9cef-8fc4fe9ceb8d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:58.279803 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-82e1524b-ceb5-4508-9cef-8fc4fe9ceb8d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:58.284176 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-82e1524b-ceb5-4508-9cef-8fc4fe9ceb8d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:58.285236 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-82e1524b-ceb5-4508-9cef-8fc4fe9ceb8d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:58.286100 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-82e1524b-ceb5-4508-9cef-8fc4fe9ceb8d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:58.286579 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-82e1524b-ceb5-4508-9cef-8fc4fe9ceb8d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:58.323565 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-82e1524b-ceb5-4508-9cef-8fc4fe9ceb8d tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051409 Jul 12 17:49:58.324681 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 571/1149] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 12 17:49:58 2022] GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 17:49:58.388482 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-dc74d35d-2085-46ba-bb74-13ac05e9f8af tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:58.389256 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-dc74d35d-2085-46ba-bb74-13ac05e9f8af tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:58.396504 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-dc74d35d-2085-46ba-bb74-13ac05e9f8af tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:58.396962 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-dc74d35d-2085-46ba-bb74-13ac05e9f8af tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:58.397757 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-dc74d35d-2085-46ba-bb74-13ac05e9f8af tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:58.398196 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-dc74d35d-2085-46ba-bb74-13ac05e9f8af tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:58.426788 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-dc74d35d-2085-46ba-bb74-13ac05e9f8af tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Going to try to terminate instance {{(pid=130059) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:49:58.807336 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-dc74d35d-2085-46ba-bb74-13ac05e9f8af tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435" status: 204 len: 0 microversion: 2.1 time: 0.422498 Jul 12 17:49:58.808008 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 579/1150] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 12 17:49:58 2022] DELETE /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:49:58.816653 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-3f1ef4e0-68a6-47f2-a7fa-a199a4dbc422 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:58.817322 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-3f1ef4e0-68a6-47f2-a7fa-a199a4dbc422 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:58.824496 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3f1ef4e0-68a6-47f2-a7fa-a199a4dbc422 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:58.824959 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3f1ef4e0-68a6-47f2-a7fa-a199a4dbc422 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:58.825731 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3f1ef4e0-68a6-47f2-a7fa-a199a4dbc422 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:58.826172 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3f1ef4e0-68a6-47f2-a7fa-a199a4dbc422 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:58.851653 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-fccf1589-220f-4c3b-8d30-fbc3fb6f4173 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:49:58.854613 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-fccf1589-220f-4c3b-8d30-fbc3fb6f4173 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 89e0c5bc-485b-4baa-ae1f-872099e94913] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:49:58.865563 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fccf1589-220f-4c3b-8d30-fbc3fb6f4173 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:58.866245 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fccf1589-220f-4c3b-8d30-fbc3fb6f4173 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:58.867288 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fccf1589-220f-4c3b-8d30-fbc3fb6f4173 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:49:58.867560 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fccf1589-220f-4c3b-8d30-fbc3fb6f4173 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:49:59.005023 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-fccf1589-220f-4c3b-8d30-fbc3fb6f4173 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:49:59.012812 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-fccf1589-220f-4c3b-8d30-fbc3fb6f4173 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913" status: 200 len: 1318 microversion: 2.1 time: 0.165532 Jul 12 17:49:59.013389 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 580/1151] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:49:58 2022] GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:49:59.037110 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-3f1ef4e0-68a6-47f2-a7fa-a199a4dbc422 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:49:59.044838 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-3f1ef4e0-68a6-47f2-a7fa-a199a4dbc422 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435" status: 200 len: 1674 microversion: 2.1 time: 0.232615 Jul 12 17:49:59.045506 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 572/1152] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:49:58 2022] GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435 => generated 1674 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:50:00.029783 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-1b92564c-dcbc-4050-a5f1-e51a1176361c tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:50:00.030415 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-1b92564c-dcbc-4050-a5f1-e51a1176361c tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 89e0c5bc-485b-4baa-ae1f-872099e94913] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:50:00.037122 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1b92564c-dcbc-4050-a5f1-e51a1176361c tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:00.037576 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1b92564c-dcbc-4050-a5f1-e51a1176361c tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:00.038357 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1b92564c-dcbc-4050-a5f1-e51a1176361c tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:00.038837 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-1b92564c-dcbc-4050-a5f1-e51a1176361c tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:00.062243 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-063f4692-6cb1-4114-b9ed-506c58e661ee tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:50:00.062885 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-063f4692-6cb1-4114-b9ed-506c58e661ee tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:50:00.070931 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-063f4692-6cb1-4114-b9ed-506c58e661ee tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:00.071318 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-063f4692-6cb1-4114-b9ed-506c58e661ee tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:00.072057 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-063f4692-6cb1-4114-b9ed-506c58e661ee tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:00.072503 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-063f4692-6cb1-4114-b9ed-506c58e661ee tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:00.202919 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-1b92564c-dcbc-4050-a5f1-e51a1176361c tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:50:00.207209 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-1b92564c-dcbc-4050-a5f1-e51a1176361c tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913" status: 200 len: 1318 microversion: 2.1 time: 0.180541 Jul 12 17:50:00.216632 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 581/1153] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:50:00 2022] GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:50:00.301059 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-063f4692-6cb1-4114-b9ed-506c58e661ee tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:50:00.313031 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-063f4692-6cb1-4114-b9ed-506c58e661ee tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435" status: 200 len: 1674 microversion: 2.1 time: 0.254201 Jul 12 17:50:00.313760 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 573/1154] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:50:00 2022] GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435 => generated 1674 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:50:01.088539 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-ef1b9965-0e1d-4d01-86b7-84c7412acc67 req-4bf97cf5-9418-4fab-a0ff-31ebafc9ea10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89e0c5bc-485b-4baa-ae1f-872099e94913", "tag": "2aaeeac7-47e4-4d5a-b93a-8c63f6b0ccb4"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:50:01.111711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-ef1b9965-0e1d-4d01-86b7-84c7412acc67 req-4bf97cf5-9418-4fab-a0ff-31ebafc9ea10 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:01.112160 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-ef1b9965-0e1d-4d01-86b7-84c7412acc67 req-4bf97cf5-9418-4fab-a0ff-31ebafc9ea10 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:01.126203 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:50:01.146553 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-ef1b9965-0e1d-4d01-86b7-84c7412acc67 req-4bf97cf5-9418-4fab-a0ff-31ebafc9ea10 service nova] Creating event network-changed:2aaeeac7-47e4-4d5a-b93a-8c63f6b0ccb4 for instance 89e0c5bc-485b-4baa-ae1f-872099e94913 on hv-cinder-84875 Jul 12 17:50:01.152352 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-ef1b9965-0e1d-4d01-86b7-84c7412acc67 req-4bf97cf5-9418-4fab-a0ff-31ebafc9ea10 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067363 Jul 12 17:50:01.155730 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 582/1155] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:50:01.225676 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-f914fcaa-fa3c-4778-a15d-a8c7e94dfcb0 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:50:01.227022 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-f914fcaa-fa3c-4778-a15d-a8c7e94dfcb0 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 89e0c5bc-485b-4baa-ae1f-872099e94913] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:50:01.235144 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f914fcaa-fa3c-4778-a15d-a8c7e94dfcb0 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:01.235814 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f914fcaa-fa3c-4778-a15d-a8c7e94dfcb0 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:01.236790 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f914fcaa-fa3c-4778-a15d-a8c7e94dfcb0 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:01.237400 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f914fcaa-fa3c-4778-a15d-a8c7e94dfcb0 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:01.330511 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-db04ec2c-7689-486c-889f-d0d048f3dbc9 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:50:01.331242 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-db04ec2c-7689-486c-889f-d0d048f3dbc9 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:50:01.340675 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-db04ec2c-7689-486c-889f-d0d048f3dbc9 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:01.346403 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-db04ec2c-7689-486c-889f-d0d048f3dbc9 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:01.346403 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-db04ec2c-7689-486c-889f-d0d048f3dbc9 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:01.346403 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-db04ec2c-7689-486c-889f-d0d048f3dbc9 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:01.546766 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-f914fcaa-fa3c-4778-a15d-a8c7e94dfcb0 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:50:01.554793 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-f914fcaa-fa3c-4778-a15d-a8c7e94dfcb0 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913" status: 200 len: 1318 microversion: 2.1 time: 0.333768 Jul 12 17:50:01.555379 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 574/1156] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:50:01 2022] GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913 => generated 1318 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:50:01.605606 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-db04ec2c-7689-486c-889f-d0d048f3dbc9 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:50:01.608602 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-db04ec2c-7689-486c-889f-d0d048f3dbc9 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435" status: 200 len: 1674 microversion: 2.1 time: 0.282868 Jul 12 17:50:01.609623 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 583/1157] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:50:01 2022] GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435 => generated 1674 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:50:02.499254 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-400365a5-c1c9-487e-ba00-ec8aa1f67829 req-f87be7ae-bbfc-4ead-a007-e6ac14d7d8a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8980ef12-e677-4a55-b5dc-e1c27b4fb435", "name": "network-vif-deleted", "tag": "994a1fb7-a76c-4821-99c7-9236c7c846e2"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:50:02.511581 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-400365a5-c1c9-487e-ba00-ec8aa1f67829 req-f87be7ae-bbfc-4ead-a007-e6ac14d7d8a0 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:02.511581 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-400365a5-c1c9-487e-ba00-ec8aa1f67829 req-f87be7ae-bbfc-4ead-a007-e6ac14d7d8a0 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:02.524171 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-400365a5-c1c9-487e-ba00-ec8aa1f67829 req-f87be7ae-bbfc-4ead-a007-e6ac14d7d8a0 service nova] Creating event network-vif-deleted:994a1fb7-a76c-4821-99c7-9236c7c846e2 for instance 8980ef12-e677-4a55-b5dc-e1c27b4fb435 on hv-cinder-84875 Jul 12 17:50:02.531434 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-400365a5-c1c9-487e-ba00-ec8aa1f67829 req-f87be7ae-bbfc-4ead-a007-e6ac14d7d8a0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113970 Jul 12 17:50:02.532461 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 575/1158] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:50:02.573279 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-ade074aa-16b7-486c-a142-a289b6d37efe tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:50:02.574011 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-ade074aa-16b7-486c-a142-a289b6d37efe tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 89e0c5bc-485b-4baa-ae1f-872099e94913] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:50:02.581002 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ade074aa-16b7-486c-a142-a289b6d37efe tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:02.581493 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ade074aa-16b7-486c-a142-a289b6d37efe tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:02.582361 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ade074aa-16b7-486c-a142-a289b6d37efe tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:02.582837 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-ade074aa-16b7-486c-a142-a289b6d37efe tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:02.629685 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-5a6ac284-6a27-4506-b914-9f160570bfed tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:50:02.630363 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-5a6ac284-6a27-4506-b914-9f160570bfed tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:50:02.640398 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5a6ac284-6a27-4506-b914-9f160570bfed tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:02.640398 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5a6ac284-6a27-4506-b914-9f160570bfed tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:02.640398 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5a6ac284-6a27-4506-b914-9f160570bfed tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:02.640398 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-5a6ac284-6a27-4506-b914-9f160570bfed tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:02.730087 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-5a6ac284-6a27-4506-b914-9f160570bfed tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:50:02.738116 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-5a6ac284-6a27-4506-b914-9f160570bfed tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435" status: 200 len: 1607 microversion: 2.1 time: 0.112821 Jul 12 17:50:02.738741 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 576/1159] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:50:02 2022] GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435 => generated 1607 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:50:02.762716 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-ade074aa-16b7-486c-a142-a289b6d37efe tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:50:02.771387 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-ade074aa-16b7-486c-a142-a289b6d37efe tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913" status: 200 len: 1318 microversion: 2.1 time: 0.202709 Jul 12 17:50:02.772525 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 584/1160] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:50:02 2022] GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:50:03.756120 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-d7cdedc1-6760-4e06-9bd4-caa71126070c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:50:03.756747 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-d7cdedc1-6760-4e06-9bd4-caa71126070c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:50:03.763516 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d7cdedc1-6760-4e06-9bd4-caa71126070c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:03.764115 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d7cdedc1-6760-4e06-9bd4-caa71126070c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:03.764915 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d7cdedc1-6760-4e06-9bd4-caa71126070c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:03.765363 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d7cdedc1-6760-4e06-9bd4-caa71126070c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:03.790271 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-054203ff-95b4-4001-953b-365775cb98b8 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:50:03.791056 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-054203ff-95b4-4001-953b-365775cb98b8 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 89e0c5bc-485b-4baa-ae1f-872099e94913] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:50:03.803000 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-054203ff-95b4-4001-953b-365775cb98b8 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:03.803461 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-054203ff-95b4-4001-953b-365775cb98b8 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:03.804705 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-054203ff-95b4-4001-953b-365775cb98b8 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:03.805146 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-054203ff-95b4-4001-953b-365775cb98b8 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:03.826147 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d7cdedc1-6760-4e06-9bd4-caa71126070c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:03.826645 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-d7cdedc1-6760-4e06-9bd4-caa71126070c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:03.827578 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.objects.instance [None req-d7cdedc1-6760-4e06-9bd4-caa71126070c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lazy-loading 'fault' on Instance uuid 8980ef12-e677-4a55-b5dc-e1c27b4fb435 {{(pid=130058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:50:03.893578 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-d7cdedc1-6760-4e06-9bd4-caa71126070c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d86a1cde9f407cae8ac050fe000d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041c2c26c82a44d98d2229969c1f3618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:50:03.902580 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-d7cdedc1-6760-4e06-9bd4-caa71126070c tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435" status: 200 len: 1328 microversion: 2.1 time: 0.150988 Jul 12 17:50:03.903374 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 577/1161] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:50:03 2022] GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435 => generated 1328 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:50:03.950170 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-054203ff-95b4-4001-953b-365775cb98b8 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:50:03.957213 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-054203ff-95b4-4001-953b-365775cb98b8 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913" status: 200 len: 1318 microversion: 2.1 time: 0.170104 Jul 12 17:50:03.957871 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 585/1162] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:50:03 2022] GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:50:04.920143 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-04c50c0e-99c1-4801-afd7-85559269cae4 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:50:04.920868 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-04c50c0e-99c1-4801-afd7-85559269cae4 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:50:04.927673 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-04c50c0e-99c1-4801-afd7-85559269cae4 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:04.928129 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-04c50c0e-99c1-4801-afd7-85559269cae4 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:04.928942 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-04c50c0e-99c1-4801-afd7-85559269cae4 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:04.929388 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-04c50c0e-99c1-4801-afd7-85559269cae4 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:04.944077 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.wsgi [None req-04c50c0e-99c1-4801-afd7-85559269cae4 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] HTTP exception thrown: Instance 8980ef12-e677-4a55-b5dc-e1c27b4fb435 could not be found. Jul 12 17:50:04.945965 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-04c50c0e-99c1-4801-afd7-85559269cae4 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Request method failure captured: Jul 12 17:50:04.945965 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: request: GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435 HTTP/1.1 Jul 12 17:50:04.945965 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept: application/json Jul 12 17:50:04.945965 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Accept-Encoding: identity Jul 12 17:50:04.945965 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Connection: close Jul 12 17:50:04.945965 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Length: 0 Jul 12 17:50:04.945965 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Content-Type: application/json Jul 12 17:50:04.945965 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Host: 10.222.0.16 Jul 12 17:50:04.945965 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Openstack-System-Scope: None Jul 12 17:50:04.945965 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: User-Agent: python-urllib3/1.26.9 Jul 12 17:50:04.945965 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Auth-Token: gAAAAABizbMmt4YCwTUeC4XdvUZe4H27QldHz3HRAPXmXVkUeBDN7Bcjfm4m6bE-hW_zXJAaxHvCivgFt_WIiQMi1EBD4q7XQdv127t-mSWI9EhHju6oMUzqWKnGyGgi5-JVpl0yaf80XSahng2N9wh8GG30r8BRA1FWo2T8Wmyi1dTiZJ0KL9M Jul 12 17:50:04.945965 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Id: None Jul 12 17:50:04.945965 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Domain-Name: None Jul 12 17:50:04.945965 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Identity-Status: Confirmed Jul 12 17:50:04.945965 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Is-Admin-Project: True Jul 12 17:50:04.945965 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Id: default Jul 12 17:50:04.945965 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Domain-Name: Default Jul 12 17:50:04.945965 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Id: 041c2c26c82a44d98d2229969c1f3618 Jul 12 17:50:04.945965 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Project-Name: tempest-AttachVolumeTestJSON-1823537430 Jul 12 17:50:04.945965 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Role: reader,member Jul 12 17:50:04.945965 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Roles: reader,member Jul 12 17:50:04.947645 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/041c2c26c82a44d98d2229969c1f3618"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_041c2c26c82a44d98d2229969c1f3618", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/041c2c26c82a44d98d2229969c1f3618"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/041c2c26c82a44d98d2229969c1f3618"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:50:04.947645 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant: tempest-AttachVolumeTestJSON-1823537430 Jul 12 17:50:04.947645 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Id: 041c2c26c82a44d98d2229969c1f3618 Jul 12 17:50:04.947645 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1823537430 Jul 12 17:50:04.947645 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User: tempest-AttachVolumeTestJSON-1823537430-project Jul 12 17:50:04.947645 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Id: default Jul 12 17:50:04.947645 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Domain-Name: Default Jul 12 17:50:04.947645 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Id: e3d86a1cde9f407cae8ac050fe000d47 Jul 12 17:50:04.947645 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: X-User-Name: tempest-AttachVolumeTestJSON-1823537430-project Jul 12 17:50:04.947645 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: method: > Jul 12 17:50:04.947645 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: exception: Instance 8980ef12-e677-4a55-b5dc-e1c27b4fb435 could not be found. Jul 12 17:50:04.947645 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: action_args: {'id': '8980ef12-e677-4a55-b5dc-e1c27b4fb435'} Jul 12 17:50:04.948558 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:50:04.948558 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:50:04.948558 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:50:04.948558 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:50:04.948558 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:50:04.948558 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:50:04.948558 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:50:04.948558 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:50:04.948558 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:50:04.948558 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:50:04.948558 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8980ef12-e677-4a55-b5dc-e1c27b4fb435 could not be found. Jul 12 17:50:04.948558 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:50:04.948558 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:50:04.948558 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:50:04.948558 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:50:04.948558 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:50:04.948558 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:50:04.948558 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:50:04.948558 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:50:04.948558 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:50:04.950122 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:50:04.950122 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:50:04.950122 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:50:04.950122 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:50:04.950122 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:50:04.950122 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:50:04.950122 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:50:04.950122 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8980ef12-e677-4a55-b5dc-e1c27b4fb435 could not be found. Jul 12 17:50:04.950122 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:50:04.950122 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:50:04.950122 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:50:04.950122 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:50:04.950122 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:50:04.950122 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:50:04.950122 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:50:04.950122 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:50:04.950122 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8980ef12-e677-4a55-b5dc-e1c27b4fb435 could not be found. Jul 12 17:50:04.950122 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: ERROR nova.api.openstack.wsgi Jul 12 17:50:04.952305 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-04c50c0e-99c1-4801-afd7-85559269cae4 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Returning 404 to user: Instance 8980ef12-e677-4a55-b5dc-e1c27b4fb435 could not be found. {{(pid=130058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:50:04.953216 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-04c50c0e-99c1-4801-afd7-85559269cae4 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435" status: 404 len: 111 microversion: 2.1 time: 0.037008 Jul 12 17:50:04.953786 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 578/1163] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:50:04 2022] GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:50:04.962904 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-cb394fa5-8b4b-4b63-9a5a-44e70abc6d39 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '.version_select at 0x7f47ac100e50>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:50:04.978840 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-cb965beb-d65e-4abc-8f74-0d9be4595dfa tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:50:04.979564 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-cb965beb-d65e-4abc-8f74-0d9be4595dfa tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 89e0c5bc-485b-4baa-ae1f-872099e94913] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:50:04.986275 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cb965beb-d65e-4abc-8f74-0d9be4595dfa tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:04.986869 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cb965beb-d65e-4abc-8f74-0d9be4595dfa tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:04.988141 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cb965beb-d65e-4abc-8f74-0d9be4595dfa tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:04.988658 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-cb965beb-d65e-4abc-8f74-0d9be4595dfa tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:05.046978 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-cb394fa5-8b4b-4b63-9a5a-44e70abc6d39 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1984682139" status: 202 len: 0 microversion: 2.1 time: 0.087846 Jul 12 17:50:05.051970 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 586/1164] 10.222.0.16 () {58 vars in 1220 bytes} [Tue Jul 12 17:50:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1984682139 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 17:50:05.256303 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-cb965beb-d65e-4abc-8f74-0d9be4595dfa tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:50:05.263863 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-cb965beb-d65e-4abc-8f74-0d9be4595dfa tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913" status: 200 len: 1318 microversion: 2.1 time: 0.293891 Jul 12 17:50:05.264436 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 579/1165] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:50:04 2022] GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:50:06.281664 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-309bb0b8-25cc-40b7-b3f1-ad0c055a9ddb tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:50:06.282291 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-309bb0b8-25cc-40b7-b3f1-ad0c055a9ddb tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 89e0c5bc-485b-4baa-ae1f-872099e94913] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:50:06.285543 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:DELETE=2 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:50:06.291583 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-309bb0b8-25cc-40b7-b3f1-ad0c055a9ddb tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:06.292111 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-309bb0b8-25cc-40b7-b3f1-ad0c055a9ddb tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:06.293150 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-309bb0b8-25cc-40b7-b3f1-ad0c055a9ddb tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:06.293593 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-309bb0b8-25cc-40b7-b3f1-ad0c055a9ddb tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:06.452542 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-309bb0b8-25cc-40b7-b3f1-ad0c055a9ddb tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:50:06.460685 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-309bb0b8-25cc-40b7-b3f1-ad0c055a9ddb tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913" status: 200 len: 1318 microversion: 2.1 time: 0.182956 Jul 12 17:50:06.461243 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 587/1166] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:50:06 2022] GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:50:07.229893 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell0:SELECT=2 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:50:07.230705 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell0:SELECT=8 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:50:07.438821 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-61d9cdd9-9165-42a3-97e8-972d4b2f98bb req-f8963f3f-f06d-4b2c-a174-45cf7b0be159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89e0c5bc-485b-4baa-ae1f-872099e94913", "name": "network-vif-plugged", "status": "completed", "tag": "2aaeeac7-47e4-4d5a-b93a-8c63f6b0ccb4"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:50:07.443267 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:50:07.448451 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-61d9cdd9-9165-42a3-97e8-972d4b2f98bb req-f8963f3f-f06d-4b2c-a174-45cf7b0be159 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:07.448899 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-61d9cdd9-9165-42a3-97e8-972d4b2f98bb req-f8963f3f-f06d-4b2c-a174-45cf7b0be159 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:07.459879 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-61d9cdd9-9165-42a3-97e8-972d4b2f98bb req-f8963f3f-f06d-4b2c-a174-45cf7b0be159 service nova] Creating event network-vif-plugged:2aaeeac7-47e4-4d5a-b93a-8c63f6b0ccb4 for instance 89e0c5bc-485b-4baa-ae1f-872099e94913 on hv-cinder-84875 Jul 12 17:50:07.464881 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-61d9cdd9-9165-42a3-97e8-972d4b2f98bb req-f8963f3f-f06d-4b2c-a174-45cf7b0be159 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239907 Jul 12 17:50:07.465470 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 580/1167] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:50:07.477651 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-7a8eba3b-86f5-4414-ba13-412dee7cf4eb tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:50:07.478250 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-7a8eba3b-86f5-4414-ba13-412dee7cf4eb tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 89e0c5bc-485b-4baa-ae1f-872099e94913] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:50:07.485180 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7a8eba3b-86f5-4414-ba13-412dee7cf4eb tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:07.494834 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7a8eba3b-86f5-4414-ba13-412dee7cf4eb tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:07.494834 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7a8eba3b-86f5-4414-ba13-412dee7cf4eb tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:07.494834 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-7a8eba3b-86f5-4414-ba13-412dee7cf4eb tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:07.626042 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-7a8eba3b-86f5-4414-ba13-412dee7cf4eb tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:50:07.640726 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-7a8eba3b-86f5-4414-ba13-412dee7cf4eb tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913" status: 200 len: 1318 microversion: 2.1 time: 0.162869 Jul 12 17:50:07.640726 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 588/1168] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:50:07 2022] GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:50:08.656924 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-f4fb0dce-0836-43d3-91cc-321943326155 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:50:08.657438 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-f4fb0dce-0836-43d3-91cc-321943326155 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 89e0c5bc-485b-4baa-ae1f-872099e94913] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:50:08.665261 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f4fb0dce-0836-43d3-91cc-321943326155 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:08.666240 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f4fb0dce-0836-43d3-91cc-321943326155 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:08.667052 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f4fb0dce-0836-43d3-91cc-321943326155 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:08.667863 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f4fb0dce-0836-43d3-91cc-321943326155 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:08.683149 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-e839ccb1-051f-49e3-a90d-6a322b736329 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:50:08.683751 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-e839ccb1-051f-49e3-a90d-6a322b736329 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:50:08.691627 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e839ccb1-051f-49e3-a90d-6a322b736329 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:08.692168 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e839ccb1-051f-49e3-a90d-6a322b736329 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:08.693128 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e839ccb1-051f-49e3-a90d-6a322b736329 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:08.693648 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-e839ccb1-051f-49e3-a90d-6a322b736329 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:08.708465 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-e839ccb1-051f-49e3-a90d-6a322b736329 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] HTTP exception thrown: Instance 8980ef12-e677-4a55-b5dc-e1c27b4fb435 could not be found. Jul 12 17:50:08.710155 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-e839ccb1-051f-49e3-a90d-6a322b736329 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Request method failure captured: Jul 12 17:50:08.710155 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: DELETE /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435 HTTP/1.1 Jul 12 17:50:08.710155 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:50:08.710155 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:50:08.710155 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:50:08.710155 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 0 Jul 12 17:50:08.710155 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:50:08.710155 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:50:08.710155 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:50:08.710155 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:50:08.710155 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbMmt4YCwTUeC4XdvUZe4H27QldHz3HRAPXmXVkUeBDN7Bcjfm4m6bE-hW_zXJAaxHvCivgFt_WIiQMi1EBD4q7XQdv127t-mSWI9EhHju6oMUzqWKnGyGgi5-JVpl0yaf80XSahng2N9wh8GG30r8BRA1FWo2T8Wmyi1dTiZJ0KL9M Jul 12 17:50:08.710155 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:50:08.710155 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:50:08.710155 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:50:08.710155 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:50:08.710155 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:50:08.710155 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:50:08.710155 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: 041c2c26c82a44d98d2229969c1f3618 Jul 12 17:50:08.710155 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-AttachVolumeTestJSON-1823537430 Jul 12 17:50:08.710155 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:50:08.710155 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:50:08.711840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/041c2c26c82a44d98d2229969c1f3618"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_041c2c26c82a44d98d2229969c1f3618", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/041c2c26c82a44d98d2229969c1f3618"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/041c2c26c82a44d98d2229969c1f3618"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:50:08.711840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-AttachVolumeTestJSON-1823537430 Jul 12 17:50:08.711840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: 041c2c26c82a44d98d2229969c1f3618 Jul 12 17:50:08.711840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1823537430 Jul 12 17:50:08.711840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-AttachVolumeTestJSON-1823537430-project Jul 12 17:50:08.711840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:50:08.711840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:50:08.711840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: e3d86a1cde9f407cae8ac050fe000d47 Jul 12 17:50:08.711840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-AttachVolumeTestJSON-1823537430-project Jul 12 17:50:08.711840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: > Jul 12 17:50:08.711840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Instance 8980ef12-e677-4a55-b5dc-e1c27b4fb435 could not be found. Jul 12 17:50:08.711840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'id': '8980ef12-e677-4a55-b5dc-e1c27b4fb435'} Jul 12 17:50:08.712678 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:50:08.712678 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:50:08.712678 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:50:08.712678 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:50:08.712678 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:50:08.712678 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:50:08.712678 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:50:08.712678 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:50:08.712678 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:50:08.712678 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:50:08.712678 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8980ef12-e677-4a55-b5dc-e1c27b4fb435 could not be found. Jul 12 17:50:08.712678 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:50:08.712678 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:50:08.712678 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:50:08.712678 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:50:08.712678 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:50:08.712678 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:50:08.712678 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:50:08.712678 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:50:08.712678 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:50:08.713936 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:50:08.713936 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 17:50:08.713936 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 17:50:08.713936 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 17:50:08.713936 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 17:50:08.713936 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:50:08.713936 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:50:08.713936 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:50:08.713936 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:50:08.713936 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8980ef12-e677-4a55-b5dc-e1c27b4fb435 could not be found. Jul 12 17:50:08.713936 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:50:08.713936 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:50:08.713936 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:50:08.713936 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:50:08.713936 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:50:08.713936 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:50:08.713936 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:50:08.713936 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:50:08.713936 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8980ef12-e677-4a55-b5dc-e1c27b4fb435 could not be found. Jul 12 17:50:08.713936 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:50:08.715382 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-e839ccb1-051f-49e3-a90d-6a322b736329 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Returning 404 to user: Instance 8980ef12-e677-4a55-b5dc-e1c27b4fb435 could not be found. {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:50:08.715382 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-e839ccb1-051f-49e3-a90d-6a322b736329 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435" status: 404 len: 111 microversion: 2.1 time: 0.032836 Jul 12 17:50:08.715382 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 589/1169] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 12 17:50:08 2022] DELETE /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 17:50:08.720303 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-f0bc6441-82ef-46e3-96f3-f9e3502b9260 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:50:08.720915 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-f0bc6441-82ef-46e3-96f3-f9e3502b9260 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: 8980ef12-e677-4a55-b5dc-e1c27b4fb435] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:50:08.728073 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f0bc6441-82ef-46e3-96f3-f9e3502b9260 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:08.728564 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f0bc6441-82ef-46e3-96f3-f9e3502b9260 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:08.729441 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f0bc6441-82ef-46e3-96f3-f9e3502b9260 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:08.729891 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f0bc6441-82ef-46e3-96f3-f9e3502b9260 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:08.743659 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-f0bc6441-82ef-46e3-96f3-f9e3502b9260 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] HTTP exception thrown: Instance 8980ef12-e677-4a55-b5dc-e1c27b4fb435 could not be found. Jul 12 17:50:08.745205 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-f0bc6441-82ef-46e3-96f3-f9e3502b9260 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Request method failure captured: Jul 12 17:50:08.745205 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435 HTTP/1.1 Jul 12 17:50:08.745205 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:50:08.745205 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:50:08.745205 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:50:08.745205 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 0 Jul 12 17:50:08.745205 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:50:08.745205 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:50:08.745205 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:50:08.745205 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:50:08.745205 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbMmt4YCwTUeC4XdvUZe4H27QldHz3HRAPXmXVkUeBDN7Bcjfm4m6bE-hW_zXJAaxHvCivgFt_WIiQMi1EBD4q7XQdv127t-mSWI9EhHju6oMUzqWKnGyGgi5-JVpl0yaf80XSahng2N9wh8GG30r8BRA1FWo2T8Wmyi1dTiZJ0KL9M Jul 12 17:50:08.745205 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:50:08.745205 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:50:08.745205 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:50:08.745205 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:50:08.745205 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:50:08.745205 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:50:08.745205 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: 041c2c26c82a44d98d2229969c1f3618 Jul 12 17:50:08.745205 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-AttachVolumeTestJSON-1823537430 Jul 12 17:50:08.745205 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:50:08.745205 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:50:08.747091 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/041c2c26c82a44d98d2229969c1f3618"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_041c2c26c82a44d98d2229969c1f3618", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/041c2c26c82a44d98d2229969c1f3618"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/041c2c26c82a44d98d2229969c1f3618"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:50:08.747091 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-AttachVolumeTestJSON-1823537430 Jul 12 17:50:08.747091 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: 041c2c26c82a44d98d2229969c1f3618 Jul 12 17:50:08.747091 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1823537430 Jul 12 17:50:08.747091 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-AttachVolumeTestJSON-1823537430-project Jul 12 17:50:08.747091 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:50:08.747091 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:50:08.747091 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: e3d86a1cde9f407cae8ac050fe000d47 Jul 12 17:50:08.747091 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-AttachVolumeTestJSON-1823537430-project Jul 12 17:50:08.747091 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: > Jul 12 17:50:08.747091 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Instance 8980ef12-e677-4a55-b5dc-e1c27b4fb435 could not be found. Jul 12 17:50:08.747091 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'id': '8980ef12-e677-4a55-b5dc-e1c27b4fb435'} Jul 12 17:50:08.748017 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:50:08.748017 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:50:08.748017 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:50:08.748017 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:50:08.748017 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:50:08.748017 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:50:08.748017 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:50:08.748017 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:50:08.748017 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:50:08.748017 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:50:08.748017 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8980ef12-e677-4a55-b5dc-e1c27b4fb435 could not be found. Jul 12 17:50:08.748017 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:50:08.748017 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:50:08.748017 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:50:08.748017 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:50:08.748017 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:50:08.748017 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:50:08.748017 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:50:08.748017 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:50:08.748017 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:50:08.749528 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:50:08.749528 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:50:08.749528 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:50:08.749528 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:50:08.749528 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:50:08.749528 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:50:08.749528 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:50:08.749528 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8980ef12-e677-4a55-b5dc-e1c27b4fb435 could not be found. Jul 12 17:50:08.749528 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:50:08.749528 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:50:08.749528 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:50:08.749528 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:50:08.749528 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:50:08.749528 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:50:08.749528 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:50:08.749528 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:50:08.749528 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8980ef12-e677-4a55-b5dc-e1c27b4fb435 could not be found. Jul 12 17:50:08.749528 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:50:08.751267 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-f0bc6441-82ef-46e3-96f3-f9e3502b9260 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Returning 404 to user: Instance 8980ef12-e677-4a55-b5dc-e1c27b4fb435 could not be found. {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:50:08.751267 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-f0bc6441-82ef-46e3-96f3-f9e3502b9260 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435" status: 404 len: 111 microversion: 2.1 time: 0.030168 Jul 12 17:50:08.751267 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 590/1170] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:50:08 2022] GET /compute/v2.1/servers/8980ef12-e677-4a55-b5dc-e1c27b4fb435 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 17:50:08.804289 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-f4fb0dce-0836-43d3-91cc-321943326155 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:50:08.812096 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-f4fb0dce-0836-43d3-91cc-321943326155 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913" status: 200 len: 1318 microversion: 2.1 time: 0.160307 Jul 12 17:50:08.812675 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 581/1171] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:50:08 2022] GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:50:09.830165 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-972c242c-7985-4c84-b19d-c9f470272ed8 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:50:09.830719 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-972c242c-7985-4c84-b19d-c9f470272ed8 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 89e0c5bc-485b-4baa-ae1f-872099e94913] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:50:09.837361 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-972c242c-7985-4c84-b19d-c9f470272ed8 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:09.837818 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-972c242c-7985-4c84-b19d-c9f470272ed8 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:09.838612 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-972c242c-7985-4c84-b19d-c9f470272ed8 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:09.839056 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-972c242c-7985-4c84-b19d-c9f470272ed8 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:09.966378 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-972c242c-7985-4c84-b19d-c9f470272ed8 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:50:09.974384 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-972c242c-7985-4c84-b19d-c9f470272ed8 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913" status: 200 len: 1507 microversion: 2.1 time: 0.148518 Jul 12 17:50:09.974975 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 591/1172] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:50:09 2022] GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:50:09.991169 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-2ab34690-6d89-4acc-b581-5ab8b9313d0b tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a58c87e7-7297-4b45-afb4-1589e369d201", "device": "/dev/sdb"}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:50:09.992302 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-2ab34690-6d89-4acc-b581-5ab8b9313d0b tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 89e0c5bc-485b-4baa-ae1f-872099e94913] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:50:09.998899 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2ab34690-6d89-4acc-b581-5ab8b9313d0b tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:09.999350 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2ab34690-6d89-4acc-b581-5ab8b9313d0b tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:10.000109 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2ab34690-6d89-4acc-b581-5ab8b9313d0b tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:10.000544 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2ab34690-6d89-4acc-b581-5ab8b9313d0b tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:10.257526 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-8f615cdd-f17d-4198-b1f6-8c315a71bcba tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:50:10.258019 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-8f615cdd-f17d-4198-b1f6-8c315a71bcba tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:50:10.264421 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8f615cdd-f17d-4198-b1f6-8c315a71bcba tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:10.266748 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8f615cdd-f17d-4198-b1f6-8c315a71bcba tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:10.266748 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8f615cdd-f17d-4198-b1f6-8c315a71bcba tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:10.266748 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8f615cdd-f17d-4198-b1f6-8c315a71bcba tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:10.280353 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-8f615cdd-f17d-4198-b1f6-8c315a71bcba tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] HTTP exception thrown: Instance c8f7b428-9b6d-459f-8ad2-cab4f82052e8 could not be found. Jul 12 17:50:10.281914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-8f615cdd-f17d-4198-b1f6-8c315a71bcba tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Request method failure captured: Jul 12 17:50:10.281914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: DELETE /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 HTTP/1.1 Jul 12 17:50:10.281914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:50:10.281914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:50:10.281914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:50:10.281914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 0 Jul 12 17:50:10.281914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:50:10.281914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:50:10.281914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:50:10.281914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:50:10.281914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbMmt4YCwTUeC4XdvUZe4H27QldHz3HRAPXmXVkUeBDN7Bcjfm4m6bE-hW_zXJAaxHvCivgFt_WIiQMi1EBD4q7XQdv127t-mSWI9EhHju6oMUzqWKnGyGgi5-JVpl0yaf80XSahng2N9wh8GG30r8BRA1FWo2T8Wmyi1dTiZJ0KL9M Jul 12 17:50:10.281914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:50:10.281914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:50:10.281914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:50:10.281914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:50:10.281914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:50:10.281914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:50:10.281914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: 041c2c26c82a44d98d2229969c1f3618 Jul 12 17:50:10.281914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-AttachVolumeTestJSON-1823537430 Jul 12 17:50:10.281914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:50:10.281914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:50:10.283567 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/041c2c26c82a44d98d2229969c1f3618"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_041c2c26c82a44d98d2229969c1f3618", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/041c2c26c82a44d98d2229969c1f3618"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/041c2c26c82a44d98d2229969c1f3618"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:50:10.283567 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-AttachVolumeTestJSON-1823537430 Jul 12 17:50:10.283567 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: 041c2c26c82a44d98d2229969c1f3618 Jul 12 17:50:10.283567 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1823537430 Jul 12 17:50:10.283567 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-AttachVolumeTestJSON-1823537430-project Jul 12 17:50:10.283567 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:50:10.283567 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:50:10.283567 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: e3d86a1cde9f407cae8ac050fe000d47 Jul 12 17:50:10.283567 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-AttachVolumeTestJSON-1823537430-project Jul 12 17:50:10.283567 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: > Jul 12 17:50:10.283567 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Instance c8f7b428-9b6d-459f-8ad2-cab4f82052e8 could not be found. Jul 12 17:50:10.283567 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'id': 'c8f7b428-9b6d-459f-8ad2-cab4f82052e8'} Jul 12 17:50:10.288143 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:50:10.288143 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:50:10.288143 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:50:10.288143 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:50:10.288143 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:50:10.288143 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:50:10.288143 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:50:10.288143 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:50:10.288143 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:50:10.288143 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:50:10.288143 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8f7b428-9b6d-459f-8ad2-cab4f82052e8 could not be found. Jul 12 17:50:10.288143 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:50:10.288143 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:50:10.288143 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:50:10.288143 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:50:10.288143 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:50:10.288143 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:50:10.288143 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:50:10.288143 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:50:10.288143 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:50:10.289590 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:50:10.289590 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 17:50:10.289590 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 17:50:10.289590 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 17:50:10.289590 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 17:50:10.289590 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:50:10.289590 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:50:10.289590 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:50:10.289590 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:50:10.289590 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8f7b428-9b6d-459f-8ad2-cab4f82052e8 could not be found. Jul 12 17:50:10.289590 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:50:10.289590 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:50:10.289590 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:50:10.289590 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:50:10.289590 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:50:10.289590 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:50:10.289590 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:50:10.289590 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:50:10.289590 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8f7b428-9b6d-459f-8ad2-cab4f82052e8 could not be found. Jul 12 17:50:10.289590 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:50:10.306645 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-8f615cdd-f17d-4198-b1f6-8c315a71bcba tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Returning 404 to user: Instance c8f7b428-9b6d-459f-8ad2-cab4f82052e8 could not be found. {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:50:10.306645 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-8f615cdd-f17d-4198-b1f6-8c315a71bcba tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 404 len: 111 microversion: 2.1 time: 0.030745 Jul 12 17:50:10.306645 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 592/1173] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 12 17:50:10 2022] DELETE /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 17:50:10.306645 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-0679f09d-1d47-46c2-b077-4ebb16872748 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:50:10.306645 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-0679f09d-1d47-46c2-b077-4ebb16872748 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] [instance: c8f7b428-9b6d-459f-8ad2-cab4f82052e8] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:50:10.307365 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0679f09d-1d47-46c2-b077-4ebb16872748 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:10.307365 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0679f09d-1d47-46c2-b077-4ebb16872748 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:10.307365 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0679f09d-1d47-46c2-b077-4ebb16872748 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:10.307365 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0679f09d-1d47-46c2-b077-4ebb16872748 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:10.315019 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-0679f09d-1d47-46c2-b077-4ebb16872748 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] HTTP exception thrown: Instance c8f7b428-9b6d-459f-8ad2-cab4f82052e8 could not be found. Jul 12 17:50:10.317588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-0679f09d-1d47-46c2-b077-4ebb16872748 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Request method failure captured: Jul 12 17:50:10.317588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 HTTP/1.1 Jul 12 17:50:10.317588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:50:10.317588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:50:10.317588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:50:10.317588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 0 Jul 12 17:50:10.317588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:50:10.317588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:50:10.317588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:50:10.317588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:50:10.317588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbMmt4YCwTUeC4XdvUZe4H27QldHz3HRAPXmXVkUeBDN7Bcjfm4m6bE-hW_zXJAaxHvCivgFt_WIiQMi1EBD4q7XQdv127t-mSWI9EhHju6oMUzqWKnGyGgi5-JVpl0yaf80XSahng2N9wh8GG30r8BRA1FWo2T8Wmyi1dTiZJ0KL9M Jul 12 17:50:10.317588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:50:10.317588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:50:10.317588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:50:10.317588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:50:10.317588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:50:10.317588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:50:10.317588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: 041c2c26c82a44d98d2229969c1f3618 Jul 12 17:50:10.317588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-AttachVolumeTestJSON-1823537430 Jul 12 17:50:10.317588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:50:10.317588 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:50:10.323121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/041c2c26c82a44d98d2229969c1f3618"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_041c2c26c82a44d98d2229969c1f3618", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/041c2c26c82a44d98d2229969c1f3618"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/041c2c26c82a44d98d2229969c1f3618"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:50:10.323121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-AttachVolumeTestJSON-1823537430 Jul 12 17:50:10.323121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: 041c2c26c82a44d98d2229969c1f3618 Jul 12 17:50:10.323121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1823537430 Jul 12 17:50:10.323121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-AttachVolumeTestJSON-1823537430-project Jul 12 17:50:10.323121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:50:10.323121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:50:10.323121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: e3d86a1cde9f407cae8ac050fe000d47 Jul 12 17:50:10.323121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-AttachVolumeTestJSON-1823537430-project Jul 12 17:50:10.323121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: > Jul 12 17:50:10.323121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Instance c8f7b428-9b6d-459f-8ad2-cab4f82052e8 could not be found. Jul 12 17:50:10.323121 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'id': 'c8f7b428-9b6d-459f-8ad2-cab4f82052e8'} Jul 12 17:50:10.324305 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:50:10.324305 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:50:10.324305 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:50:10.324305 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:50:10.324305 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:50:10.324305 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:50:10.324305 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:50:10.324305 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:50:10.324305 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:50:10.324305 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:50:10.324305 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8f7b428-9b6d-459f-8ad2-cab4f82052e8 could not be found. Jul 12 17:50:10.324305 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:50:10.324305 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:50:10.324305 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:50:10.324305 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:50:10.324305 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:50:10.324305 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:50:10.324305 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:50:10.324305 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:50:10.324305 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:50:10.325968 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:50:10.325968 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:50:10.325968 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:50:10.325968 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:50:10.325968 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:50:10.325968 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:50:10.325968 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:50:10.325968 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8f7b428-9b6d-459f-8ad2-cab4f82052e8 could not be found. Jul 12 17:50:10.325968 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:50:10.325968 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:50:10.325968 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:50:10.325968 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:50:10.325968 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:50:10.325968 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:50:10.325968 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:50:10.325968 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:50:10.325968 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8f7b428-9b6d-459f-8ad2-cab4f82052e8 could not be found. Jul 12 17:50:10.325968 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:50:10.327404 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-0679f09d-1d47-46c2-b077-4ebb16872748 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] Returning 404 to user: Instance c8f7b428-9b6d-459f-8ad2-cab4f82052e8 could not be found. {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:50:10.327404 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-0679f09d-1d47-46c2-b077-4ebb16872748 tempest-AttachVolumeTestJSON-1823537430 tempest-AttachVolumeTestJSON-1823537430-project] 10.222.0.16 "GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8" status: 404 len: 111 microversion: 2.1 time: 0.030536 Jul 12 17:50:10.327404 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 593/1174] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:50:10 2022] GET /compute/v2.1/servers/c8f7b428-9b6d-459f-8ad2-cab4f82052e8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 17:50:10.672156 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-2ab34690-6d89-4acc-b581-5ab8b9313d0b tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "POST /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.685227 Jul 12 17:50:10.677637 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 582/1175] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jul 12 17:50:09 2022] POST /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913/os-volume_attachments => generated 194 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:50:30.694629 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-c4e6a207-be45-4633-8d32-4924e56ae1a6 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:50:30.695168 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-c4e6a207-be45-4633-8d32-4924e56ae1a6 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 89e0c5bc-485b-4baa-ae1f-872099e94913] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:50:30.697328 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_api:SELECT=13 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:50:30.697990 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=44 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:50:30.702733 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c4e6a207-be45-4633-8d32-4924e56ae1a6 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:30.709794 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c4e6a207-be45-4633-8d32-4924e56ae1a6 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:30.709794 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c4e6a207-be45-4633-8d32-4924e56ae1a6 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:30.709794 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-c4e6a207-be45-4633-8d32-4924e56ae1a6 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:30.789636 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.objects.instance [None req-c4e6a207-be45-4633-8d32-4924e56ae1a6 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lazy-loading 'services' on Instance uuid 89e0c5bc-485b-4baa-ae1f-872099e94913 {{(pid=130059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:50:30.940838 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-c4e6a207-be45-4633-8d32-4924e56ae1a6 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "DELETE /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913/os-volume_attachments/a58c87e7-7297-4b45-afb4-1589e369d201" status: 202 len: 0 microversion: 2.1 time: 0.250566 Jul 12 17:50:30.941446 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 594/1176] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jul 12 17:50:30 2022] DELETE /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913/os-volume_attachments/a58c87e7-7297-4b45-afb4-1589e369d201 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:50:32.056041 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-928af3e2-d0ff-44ec-aa9a-19869d324015 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:50:32.056617 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-928af3e2-d0ff-44ec-aa9a-19869d324015 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 89e0c5bc-485b-4baa-ae1f-872099e94913] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:50:32.059221 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_api:SELECT=5 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:50:32.059979 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:50:32.064961 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-928af3e2-d0ff-44ec-aa9a-19869d324015 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:32.065674 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-928af3e2-d0ff-44ec-aa9a-19869d324015 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:32.066417 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-928af3e2-d0ff-44ec-aa9a-19869d324015 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:32.066917 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-928af3e2-d0ff-44ec-aa9a-19869d324015 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:32.093772 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-928af3e2-d0ff-44ec-aa9a-19869d324015 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 89e0c5bc-485b-4baa-ae1f-872099e94913] Going to try to terminate instance {{(pid=130058) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:50:32.377849 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-928af3e2-d0ff-44ec-aa9a-19869d324015 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "DELETE /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913" status: 204 len: 0 microversion: 2.1 time: 0.325780 Jul 12 17:50:32.378636 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 583/1177] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 12 17:50:32 2022] DELETE /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:50:32.388043 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-668b22ca-e179-47f3-b26a-aab5a9df0a9c tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:50:32.388740 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-668b22ca-e179-47f3-b26a-aab5a9df0a9c tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 89e0c5bc-485b-4baa-ae1f-872099e94913] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:50:32.396834 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-668b22ca-e179-47f3-b26a-aab5a9df0a9c tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:32.397369 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-668b22ca-e179-47f3-b26a-aab5a9df0a9c tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:32.398194 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-668b22ca-e179-47f3-b26a-aab5a9df0a9c tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:32.398621 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-668b22ca-e179-47f3-b26a-aab5a9df0a9c tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:32.534515 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-668b22ca-e179-47f3-b26a-aab5a9df0a9c tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:50:32.542295 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-668b22ca-e179-47f3-b26a-aab5a9df0a9c tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913" status: 200 len: 1513 microversion: 2.1 time: 0.158614 Jul 12 17:50:32.542904 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 595/1178] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:50:32 2022] GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:50:33.560610 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b05501b1-35d6-4ce5-9720-ef71e8346ddd tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:50:33.561306 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-b05501b1-35d6-4ce5-9720-ef71e8346ddd tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 89e0c5bc-485b-4baa-ae1f-872099e94913] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:50:33.568300 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b05501b1-35d6-4ce5-9720-ef71e8346ddd tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:33.568766 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b05501b1-35d6-4ce5-9720-ef71e8346ddd tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:33.569528 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b05501b1-35d6-4ce5-9720-ef71e8346ddd tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:33.569966 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b05501b1-35d6-4ce5-9720-ef71e8346ddd tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:33.703185 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-b05501b1-35d6-4ce5-9720-ef71e8346ddd tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:50:33.711212 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-b05501b1-35d6-4ce5-9720-ef71e8346ddd tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913" status: 200 len: 1513 microversion: 2.1 time: 0.154860 Jul 12 17:50:33.711785 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 584/1179] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:50:33 2022] GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:50:34.716812 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [req-31984ffd-57e0-4829-a3e4-dde83241b032 req-607f682a-fa79-4826-b551-91435fe7bfc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89e0c5bc-485b-4baa-ae1f-872099e94913", "name": "network-vif-deleted", "tag": "2aaeeac7-47e4-4d5a-b93a-8c63f6b0ccb4"}]} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:50:34.726369 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-31984ffd-57e0-4829-a3e4-dde83241b032 req-607f682a-fa79-4826-b551-91435fe7bfc1 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:34.726834 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [req-31984ffd-57e0-4829-a3e4-dde83241b032 req-607f682a-fa79-4826-b551-91435fe7bfc1 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:34.729159 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-2062229e-488c-4eea-bee8-0b64824693f9 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:50:34.730595 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-2062229e-488c-4eea-bee8-0b64824693f9 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 89e0c5bc-485b-4baa-ae1f-872099e94913] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:50:34.737033 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2062229e-488c-4eea-bee8-0b64824693f9 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:34.737524 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2062229e-488c-4eea-bee8-0b64824693f9 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:34.738330 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.compute.server_external_events [req-31984ffd-57e0-4829-a3e4-dde83241b032 req-607f682a-fa79-4826-b551-91435fe7bfc1 service nova] Creating event network-vif-deleted:2aaeeac7-47e4-4d5a-b93a-8c63f6b0ccb4 for instance 89e0c5bc-485b-4baa-ae1f-872099e94913 on hv-cinder-84875 Jul 12 17:50:34.738496 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2062229e-488c-4eea-bee8-0b64824693f9 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:34.738944 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2062229e-488c-4eea-bee8-0b64824693f9 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:34.744522 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [req-31984ffd-57e0-4829-a3e4-dde83241b032 req-607f682a-fa79-4826-b551-91435fe7bfc1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031124 Jul 12 17:50:34.745119 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 596/1180] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:50:34.806273 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-2062229e-488c-4eea-bee8-0b64824693f9 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d3c959a87247cd833db555fdef9af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b0319262bc468d82fa3fba94540142', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:50:34.813828 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-2062229e-488c-4eea-bee8-0b64824693f9 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913" status: 200 len: 1471 microversion: 2.1 time: 0.088984 Jul 12 17:50:34.814401 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 585/1181] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:50:34 2022] GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913 => generated 1471 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:50:35.832179 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-d7c7d90f-f557-4149-9473-60cea7cc0e08 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:50:35.833084 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-d7c7d90f-f557-4149-9473-60cea7cc0e08 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] [instance: 89e0c5bc-485b-4baa-ae1f-872099e94913] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:50:35.839814 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d7c7d90f-f557-4149-9473-60cea7cc0e08 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:35.840256 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d7c7d90f-f557-4149-9473-60cea7cc0e08 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:35.841012 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d7c7d90f-f557-4149-9473-60cea7cc0e08 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:50:35.841442 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d7c7d90f-f557-4149-9473-60cea7cc0e08 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:50:35.854915 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-d7c7d90f-f557-4149-9473-60cea7cc0e08 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] HTTP exception thrown: Instance 89e0c5bc-485b-4baa-ae1f-872099e94913 could not be found. Jul 12 17:50:35.856724 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-d7c7d90f-f557-4149-9473-60cea7cc0e08 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Request method failure captured: Jul 12 17:50:35.856724 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913 HTTP/1.1 Jul 12 17:50:35.856724 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:50:35.856724 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:50:35.856724 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:50:35.856724 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 0 Jul 12 17:50:35.856724 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:50:35.856724 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:50:35.856724 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:50:35.856724 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:50:35.856724 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbP1RCwUJu9Tr9YtmfVTMlo7vjyRHNZ-ygufifaRD8KTPBg87CrXYrhGkMJUvPMUEuo38UEPoFiw25-OFaAj0QegFjPBqVcIr1p-Rq5JW-L_q-pLMz3L0o1CSs1eIBvbYTJ_-jeTGLGOx-P7QLY33mCZRrqiNIQcMvFFIlPPpuIzASk Jul 12 17:50:35.856724 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:50:35.856724 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:50:35.856724 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:50:35.856724 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:50:35.856724 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:50:35.856724 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:50:35.856724 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: c3b0319262bc468d82fa3fba94540142 Jul 12 17:50:35.856724 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-VolumesSnapshotTestJSON-445542671 Jul 12 17:50:35.856724 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:50:35.856724 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:50:35.858242 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c3b0319262bc468d82fa3fba94540142"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c3b0319262bc468d82fa3fba94540142", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c3b0319262bc468d82fa3fba94540142"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c3b0319262bc468d82fa3fba94540142"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:50:35.858242 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-VolumesSnapshotTestJSON-445542671 Jul 12 17:50:35.858242 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: c3b0319262bc468d82fa3fba94540142 Jul 12 17:50:35.858242 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-445542671 Jul 12 17:50:35.858242 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-VolumesSnapshotTestJSON-445542671-project Jul 12 17:50:35.858242 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:50:35.858242 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:50:35.858242 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: 01d3c959a87247cd833db555fdef9af5 Jul 12 17:50:35.858242 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-VolumesSnapshotTestJSON-445542671-project Jul 12 17:50:35.858242 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: > Jul 12 17:50:35.858242 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Instance 89e0c5bc-485b-4baa-ae1f-872099e94913 could not be found. Jul 12 17:50:35.858242 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'id': '89e0c5bc-485b-4baa-ae1f-872099e94913'} Jul 12 17:50:35.859407 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:50:35.859407 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:50:35.859407 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:50:35.859407 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:50:35.859407 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:50:35.859407 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:50:35.859407 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:50:35.859407 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:50:35.859407 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:50:35.859407 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:50:35.859407 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89e0c5bc-485b-4baa-ae1f-872099e94913 could not be found. Jul 12 17:50:35.859407 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:50:35.859407 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:50:35.859407 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:50:35.859407 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:50:35.859407 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:50:35.859407 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:50:35.859407 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:50:35.859407 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:50:35.859407 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:50:35.861009 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:50:35.861009 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:50:35.861009 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:50:35.861009 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:50:35.861009 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:50:35.861009 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:50:35.861009 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:50:35.861009 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89e0c5bc-485b-4baa-ae1f-872099e94913 could not be found. Jul 12 17:50:35.861009 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:50:35.861009 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:50:35.861009 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:50:35.861009 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:50:35.861009 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:50:35.861009 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:50:35.861009 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:50:35.861009 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:50:35.861009 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89e0c5bc-485b-4baa-ae1f-872099e94913 could not be found. Jul 12 17:50:35.861009 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:50:35.862590 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-d7c7d90f-f557-4149-9473-60cea7cc0e08 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] Returning 404 to user: Instance 89e0c5bc-485b-4baa-ae1f-872099e94913 could not be found. {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:50:35.862590 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-d7c7d90f-f557-4149-9473-60cea7cc0e08 tempest-VolumesSnapshotTestJSON-445542671 tempest-VolumesSnapshotTestJSON-445542671-project] 10.222.0.16 "GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913" status: 404 len: 111 microversion: 2.1 time: 0.030105 Jul 12 17:50:35.862590 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 597/1182] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:50:35 2022] GET /compute/v2.1/servers/89e0c5bc-485b-4baa-ae1f-872099e94913 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:52:02.059847 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:52:02.060603 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:52:02.225815 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-4cc6522e-59b2-4fd1-8308-aa40be193ecb tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Action: 'create', calling method: .version_select at 0x7f47ac05a040>, body: {"keypair": {"name": "tempest-TestShelveInstance-1273205958", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGVENi4mcCAR3gRCxCDtt6CC4GfncZnkeE7nhWwF65Wwx87ExzYTnjO+hzBL5D3MMMx7IdQuqupsOeGAwrAzbzyDjyhUq93VMwKdAAqFtiu4fEToXK2zKOGBGvSFLH8Fw=="}} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:52:02.242001 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-4cc6522e-59b2-4fd1-8308-aa40be193ecb tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Getting quotas for project f0af5b7947c74fb5879d0e9bf9ba3860. Resources: {'key_pairs'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:52:02.250946 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.quota [None req-4cc6522e-59b2-4fd1-8308-aa40be193ecb tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Getting quotas for user bb7ac2d6a1f4449595c380e164c96248 and project f0af5b7947c74fb5879d0e9bf9ba3860. Resources: {'key_pairs'} {{(pid=130058) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:52:02.371882 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-4cc6522e-59b2-4fd1-8308-aa40be193ecb tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.314376 Jul 12 17:52:02.372638 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 586/1183] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Jul 12 17:52:02 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:52:20.566685 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b682f494-dd52-4c57-b964-aabbe5ade752] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 12 17:52:20.570374 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-569ece95-2e5a-476c-a9d7-6a2ac24125dd tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1872179671", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1273205958", "security_groups": [{"name": "tempest-secgroup-smoke-1745074412"}], "networks": [{"uuid": "4ea7ed86-4c93-4ed6-9175-f6d62e11e3c6"}], "block_device_mapping_v2": [{"uuid": "f9e00285-eb01-43fe-b30d-0fc4473aa04b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:52:20.584148 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_api:SELECT=8 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:52:20.584148 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:52:20.683659 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.network.neutron [None req-569ece95-2e5a-476c-a9d7-6a2ac24125dd tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] validate_networks() for [('4ea7ed86-4c93-4ed6-9175-f6d62e11e3c6', None, None, None, None, None)] {{(pid=130059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:52:21.145512 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-569ece95-2e5a-476c-a9d7-6a2ac24125dd tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Flavor limits 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:52:21.145943 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-569ece95-2e5a-476c-a9d7-6a2ac24125dd tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Image limits 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:52:21.146419 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-569ece95-2e5a-476c-a9d7-6a2ac24125dd tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Flavor pref 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:52:21.146847 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-569ece95-2e5a-476c-a9d7-6a2ac24125dd tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Image pref 0:0:0 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:52:21.147252 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.virt.hardware [None req-569ece95-2e5a-476c-a9d7-6a2ac24125dd tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:52:21.156531 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-569ece95-2e5a-476c-a9d7-6a2ac24125dd tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:21.157001 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-569ece95-2e5a-476c-a9d7-6a2ac24125dd tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:21.157787 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-569ece95-2e5a-476c-a9d7-6a2ac24125dd tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:21.158216 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-569ece95-2e5a-476c-a9d7-6a2ac24125dd tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:21.174965 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.quota [None req-569ece95-2e5a-476c-a9d7-6a2ac24125dd tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Getting quotas for project f0af5b7947c74fb5879d0e9bf9ba3860. Resources: {'cores', 'instances', 'ram'} {{(pid=130059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:52:21.178770 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.quota [None req-569ece95-2e5a-476c-a9d7-6a2ac24125dd tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Getting quotas for user bb7ac2d6a1f4449595c380e164c96248 and project f0af5b7947c74fb5879d0e9bf9ba3860. Resources: {'cores', 'instances', 'ram'} {{(pid=130059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:52:21.234883 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-569ece95-2e5a-476c-a9d7-6a2ac24125dd tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Going to run 1 instances... {{(pid=130059) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:52:21.236951 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-569ece95-2e5a-476c-a9d7-6a2ac24125dd tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f9e00285-eb01-43fe-b30d-0fc4473aa04b',volume_size=None,volume_type=None)] {{(pid=130059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:52:21.573545 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO oslo.messaging._drivers.impl_rabbit [-] [b682f494-dd52-4c57-b964-aabbe5ade752] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 52854. Jul 12 17:52:21.623051 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-569ece95-2e5a-476c-a9d7-6a2ac24125dd tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.058139 Jul 12 17:52:21.623691 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 598/1184] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 12 17:52:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:52:21.631635 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell0:SELECT=4 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:52:21.632386 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:52:21.636246 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-1074860b-55fb-45b9-900b-bfadfd15b7d6 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:52:21.641828 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-1074860b-55fb-45b9-900b-bfadfd15b7d6 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:52:21.691926 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-1074860b-55fb-45b9-900b-bfadfd15b7d6 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:52:21.698993 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-1074860b-55fb-45b9-900b-bfadfd15b7d6 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1089 microversion: 2.1 time: 0.068878 Jul 12 17:52:21.699699 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 587/1185] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:52:21 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1089 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:52:22.717932 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-23104cbf-f7e2-4eaf-bd7f-db429b4e7a91 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:52:22.718582 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-23104cbf-f7e2-4eaf-bd7f-db429b4e7a91 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:52:22.725484 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-23104cbf-f7e2-4eaf-bd7f-db429b4e7a91 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:22.725933 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-23104cbf-f7e2-4eaf-bd7f-db429b4e7a91 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:22.726723 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-23104cbf-f7e2-4eaf-bd7f-db429b4e7a91 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:22.727158 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-23104cbf-f7e2-4eaf-bd7f-db429b4e7a91 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:22.788525 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-23104cbf-f7e2-4eaf-bd7f-db429b4e7a91 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:52:22.796817 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-23104cbf-f7e2-4eaf-bd7f-db429b4e7a91 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1139 microversion: 2.1 time: 0.083791 Jul 12 17:52:22.797374 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 599/1186] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:52:22 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:52:23.814330 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-20b53055-155f-4279-be68-bf3adafdeb64 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:52:23.814933 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-20b53055-155f-4279-be68-bf3adafdeb64 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:52:23.822854 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-20b53055-155f-4279-be68-bf3adafdeb64 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:23.823307 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-20b53055-155f-4279-be68-bf3adafdeb64 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:23.824077 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-20b53055-155f-4279-be68-bf3adafdeb64 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:23.824521 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-20b53055-155f-4279-be68-bf3adafdeb64 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:23.886206 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-20b53055-155f-4279-be68-bf3adafdeb64 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:52:23.894740 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-20b53055-155f-4279-be68-bf3adafdeb64 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1187 microversion: 2.1 time: 0.084993 Jul 12 17:52:23.895502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 588/1187] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:52:23 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:52:24.912327 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-25039a65-9640-4dfd-a577-ed1626091d8d tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:52:24.913109 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-25039a65-9640-4dfd-a577-ed1626091d8d tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:52:24.920396 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-25039a65-9640-4dfd-a577-ed1626091d8d tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:24.921632 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-25039a65-9640-4dfd-a577-ed1626091d8d tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:24.928717 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-25039a65-9640-4dfd-a577-ed1626091d8d tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:24.928717 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-25039a65-9640-4dfd-a577-ed1626091d8d tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:25.071954 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-25039a65-9640-4dfd-a577-ed1626091d8d tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:52:25.082593 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-25039a65-9640-4dfd-a577-ed1626091d8d tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1273 microversion: 2.1 time: 0.174425 Jul 12 17:52:25.083228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 600/1188] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:52:24 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1273 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:52:25.877398 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-14c4005a-2c8f-4629-b062-70f40d338227 req-f3164ad4-526a-4cbc-9790-733dc5afd10a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8defd782-54e9-4545-98ef-baab0163a1d5", "tag": "17b1439f-4cc3-4d4c-b490-310c2cd9fa90"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:52:25.885989 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-14c4005a-2c8f-4629-b062-70f40d338227 req-f3164ad4-526a-4cbc-9790-733dc5afd10a service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:25.886330 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-14c4005a-2c8f-4629-b062-70f40d338227 req-f3164ad4-526a-4cbc-9790-733dc5afd10a service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:25.907122 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-14c4005a-2c8f-4629-b062-70f40d338227 req-f3164ad4-526a-4cbc-9790-733dc5afd10a service nova] Creating event network-changed:17b1439f-4cc3-4d4c-b490-310c2cd9fa90 for instance 8defd782-54e9-4545-98ef-baab0163a1d5 on hv-cinder-84875 Jul 12 17:52:25.912215 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-14c4005a-2c8f-4629-b062-70f40d338227 req-f3164ad4-526a-4cbc-9790-733dc5afd10a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039851 Jul 12 17:52:25.912825 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 589/1189] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:52:26.099261 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-d933ab20-bb79-48db-806b-fb15894db8ed tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:52:26.099924 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-d933ab20-bb79-48db-806b-fb15894db8ed tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:52:26.106562 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d933ab20-bb79-48db-806b-fb15894db8ed tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:26.107017 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d933ab20-bb79-48db-806b-fb15894db8ed tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:26.107794 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d933ab20-bb79-48db-806b-fb15894db8ed tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:26.108232 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-d933ab20-bb79-48db-806b-fb15894db8ed tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:26.241585 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-d933ab20-bb79-48db-806b-fb15894db8ed tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:52:26.249833 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-d933ab20-bb79-48db-806b-fb15894db8ed tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1261 microversion: 2.1 time: 0.154516 Jul 12 17:52:26.250411 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 601/1190] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:52:26 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:52:27.267770 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-2ac821c0-5151-4f18-bc32-6454e1e25a8a tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:52:27.268612 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-2ac821c0-5151-4f18-bc32-6454e1e25a8a tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:52:27.274858 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2ac821c0-5151-4f18-bc32-6454e1e25a8a tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:27.275313 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2ac821c0-5151-4f18-bc32-6454e1e25a8a tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:27.276076 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2ac821c0-5151-4f18-bc32-6454e1e25a8a tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:27.276516 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-2ac821c0-5151-4f18-bc32-6454e1e25a8a tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:27.412233 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-2ac821c0-5151-4f18-bc32-6454e1e25a8a tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:52:27.419840 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-2ac821c0-5151-4f18-bc32-6454e1e25a8a tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1261 microversion: 2.1 time: 0.156802 Jul 12 17:52:27.420403 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 590/1191] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:52:27 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:52:28.437834 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-172b4037-3184-4449-9b7f-3847b760f0ef tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:52:28.438467 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-172b4037-3184-4449-9b7f-3847b760f0ef tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:52:28.444914 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-172b4037-3184-4449-9b7f-3847b760f0ef tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:28.445371 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-172b4037-3184-4449-9b7f-3847b760f0ef tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:28.446136 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-172b4037-3184-4449-9b7f-3847b760f0ef tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:28.446616 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-172b4037-3184-4449-9b7f-3847b760f0ef tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:28.580553 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-172b4037-3184-4449-9b7f-3847b760f0ef tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:52:28.588089 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-172b4037-3184-4449-9b7f-3847b760f0ef tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1261 microversion: 2.1 time: 0.155414 Jul 12 17:52:28.593504 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 602/1192] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:52:28 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:52:29.605134 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-bff68469-1741-42b3-88a9-ba520f1f4159 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:52:29.605787 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-bff68469-1741-42b3-88a9-ba520f1f4159 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:52:29.612995 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bff68469-1741-42b3-88a9-ba520f1f4159 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:29.613450 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bff68469-1741-42b3-88a9-ba520f1f4159 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:29.614216 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bff68469-1741-42b3-88a9-ba520f1f4159 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:29.614694 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-bff68469-1741-42b3-88a9-ba520f1f4159 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:29.742739 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-bff68469-1741-42b3-88a9-ba520f1f4159 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:52:29.750280 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-bff68469-1741-42b3-88a9-ba520f1f4159 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1261 microversion: 2.1 time: 0.149031 Jul 12 17:52:29.750869 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 591/1193] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:52:29 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:52:30.765911 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-68087440-d64a-4104-97a7-c22485448e29 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:52:30.766532 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-68087440-d64a-4104-97a7-c22485448e29 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:52:30.773007 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-68087440-d64a-4104-97a7-c22485448e29 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:30.773645 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-68087440-d64a-4104-97a7-c22485448e29 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:30.774419 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-68087440-d64a-4104-97a7-c22485448e29 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:30.774881 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-68087440-d64a-4104-97a7-c22485448e29 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:30.904568 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-68087440-d64a-4104-97a7-c22485448e29 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:52:30.911991 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-68087440-d64a-4104-97a7-c22485448e29 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1261 microversion: 2.1 time: 0.149930 Jul 12 17:52:30.912552 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 603/1194] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:52:30 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:52:31.928336 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-0895a20d-c617-4b26-99d4-eec8ffde5edf tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:52:31.928863 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-0895a20d-c617-4b26-99d4-eec8ffde5edf tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:52:31.936048 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0895a20d-c617-4b26-99d4-eec8ffde5edf tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:31.936502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0895a20d-c617-4b26-99d4-eec8ffde5edf tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:31.937527 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0895a20d-c617-4b26-99d4-eec8ffde5edf tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:31.937964 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0895a20d-c617-4b26-99d4-eec8ffde5edf tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:32.064407 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0895a20d-c617-4b26-99d4-eec8ffde5edf tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:52:32.071795 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-0895a20d-c617-4b26-99d4-eec8ffde5edf tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1261 microversion: 2.1 time: 0.147447 Jul 12 17:52:32.072366 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 592/1195] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:52:31 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:52:33.087439 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-aa35f675-fbb3-4fcc-aef3-ac98512da21f tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:52:33.088050 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-aa35f675-fbb3-4fcc-aef3-ac98512da21f tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:52:33.089929 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell0:SELECT=2 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:52:33.090662 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell0:SELECT=6 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:52:33.095934 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-aa35f675-fbb3-4fcc-aef3-ac98512da21f tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:33.096384 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-aa35f675-fbb3-4fcc-aef3-ac98512da21f tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:33.097152 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-aa35f675-fbb3-4fcc-aef3-ac98512da21f tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:33.097594 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-aa35f675-fbb3-4fcc-aef3-ac98512da21f tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:33.229943 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-aa35f675-fbb3-4fcc-aef3-ac98512da21f tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:52:33.237499 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-aa35f675-fbb3-4fcc-aef3-ac98512da21f tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1261 microversion: 2.1 time: 0.153904 Jul 12 17:52:33.238070 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 604/1196] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:52:33 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:52:34.254765 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-43152ad8-28c7-4d85-9b81-7817c6678b2f tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:52:34.255356 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-43152ad8-28c7-4d85-9b81-7817c6678b2f tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:52:34.257716 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell0:SELECT=2 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:52:34.263038 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-43152ad8-28c7-4d85-9b81-7817c6678b2f tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:34.263492 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-43152ad8-28c7-4d85-9b81-7817c6678b2f tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:34.264252 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-43152ad8-28c7-4d85-9b81-7817c6678b2f tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:34.264684 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-43152ad8-28c7-4d85-9b81-7817c6678b2f tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:34.398203 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-43152ad8-28c7-4d85-9b81-7817c6678b2f tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:52:34.406272 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-43152ad8-28c7-4d85-9b81-7817c6678b2f tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1261 microversion: 2.1 time: 0.155330 Jul 12 17:52:34.406801 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 593/1197] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:52:34 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:52:35.423381 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-2afd5962-7bfb-4352-86f5-719c6882c783 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:52:35.423993 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-2afd5962-7bfb-4352-86f5-719c6882c783 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:52:35.430517 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2afd5962-7bfb-4352-86f5-719c6882c783 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:35.430969 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2afd5962-7bfb-4352-86f5-719c6882c783 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:35.431727 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2afd5962-7bfb-4352-86f5-719c6882c783 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:35.432165 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2afd5962-7bfb-4352-86f5-719c6882c783 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:35.564801 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-2afd5962-7bfb-4352-86f5-719c6882c783 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:52:35.572339 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-2afd5962-7bfb-4352-86f5-719c6882c783 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1261 microversion: 2.1 time: 0.152804 Jul 12 17:52:35.572910 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 605/1198] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:52:35 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:52:35.808622 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-656e5a31-7cc0-4d3c-8f5a-ba49f57061b7 req-5430330f-b463-4b30-9154-0af01f663dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8defd782-54e9-4545-98ef-baab0163a1d5", "name": "network-vif-plugged", "status": "completed", "tag": "17b1439f-4cc3-4d4c-b490-310c2cd9fa90"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:52:35.817401 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-656e5a31-7cc0-4d3c-8f5a-ba49f57061b7 req-5430330f-b463-4b30-9154-0af01f663dc2 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:35.817883 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-656e5a31-7cc0-4d3c-8f5a-ba49f57061b7 req-5430330f-b463-4b30-9154-0af01f663dc2 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:35.829624 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-656e5a31-7cc0-4d3c-8f5a-ba49f57061b7 req-5430330f-b463-4b30-9154-0af01f663dc2 service nova] Creating event network-vif-plugged:17b1439f-4cc3-4d4c-b490-310c2cd9fa90 for instance 8defd782-54e9-4545-98ef-baab0163a1d5 on hv-cinder-84875 Jul 12 17:52:35.834683 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-656e5a31-7cc0-4d3c-8f5a-ba49f57061b7 req-5430330f-b463-4b30-9154-0af01f663dc2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029863 Jul 12 17:52:35.835260 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 594/1199] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:52:36.599464 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-fced89ae-18b7-4b8b-a351-1fc04fe0c52f tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:52:36.600109 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-fced89ae-18b7-4b8b-a351-1fc04fe0c52f tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:52:36.606889 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fced89ae-18b7-4b8b-a351-1fc04fe0c52f tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:36.607343 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fced89ae-18b7-4b8b-a351-1fc04fe0c52f tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:36.608107 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fced89ae-18b7-4b8b-a351-1fc04fe0c52f tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:36.608546 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fced89ae-18b7-4b8b-a351-1fc04fe0c52f tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:36.738458 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-fced89ae-18b7-4b8b-a351-1fc04fe0c52f tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:52:36.745878 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-fced89ae-18b7-4b8b-a351-1fc04fe0c52f tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1261 microversion: 2.1 time: 0.150326 Jul 12 17:52:36.747047 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 606/1200] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:52:36 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:52:37.764203 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b9d23c8b-18d4-4564-8f47-ff8ff4010e8b tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:52:37.764911 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-b9d23c8b-18d4-4564-8f47-ff8ff4010e8b tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:52:37.771858 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b9d23c8b-18d4-4564-8f47-ff8ff4010e8b tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:37.772310 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b9d23c8b-18d4-4564-8f47-ff8ff4010e8b tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:37.773072 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b9d23c8b-18d4-4564-8f47-ff8ff4010e8b tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:37.773544 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b9d23c8b-18d4-4564-8f47-ff8ff4010e8b tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:37.908077 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-b9d23c8b-18d4-4564-8f47-ff8ff4010e8b tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:52:37.915679 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-b9d23c8b-18d4-4564-8f47-ff8ff4010e8b tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1445 microversion: 2.1 time: 0.156235 Jul 12 17:52:37.916242 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 595/1201] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:52:37 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1445 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:52:37.932132 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-71c4fbc3-ea88-413f-bf9d-5e608d3bd215 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:52:37.932737 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-71c4fbc3-ea88-413f-bf9d-5e608d3bd215 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:52:37.939395 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-71c4fbc3-ea88-413f-bf9d-5e608d3bd215 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:37.939841 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-71c4fbc3-ea88-413f-bf9d-5e608d3bd215 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:37.940592 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-71c4fbc3-ea88-413f-bf9d-5e608d3bd215 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:37.941024 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-71c4fbc3-ea88-413f-bf9d-5e608d3bd215 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:38.072788 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-71c4fbc3-ea88-413f-bf9d-5e608d3bd215 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:52:38.080765 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-71c4fbc3-ea88-413f-bf9d-5e608d3bd215 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1445 microversion: 2.1 time: 0.152481 Jul 12 17:52:38.081328 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 607/1202] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:52:37 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1445 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:52:39.270171 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 17:52:39.270858 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Tue Jul 12 17:52:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 17:52:39.430933 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 17:52:39.431477 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Tue Jul 12 17:52:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 17:52:40.195482 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-2f47a9f0-0e47-4574-ba44-63f98976e994 req-851582fd-2191-48d1-8018-03b96412fbab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8defd782-54e9-4545-98ef-baab0163a1d5", "tag": "17b1439f-4cc3-4d4c-b490-310c2cd9fa90"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:52:40.208491 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-2f47a9f0-0e47-4574-ba44-63f98976e994 req-851582fd-2191-48d1-8018-03b96412fbab service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:52:40.208945 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-2f47a9f0-0e47-4574-ba44-63f98976e994 req-851582fd-2191-48d1-8018-03b96412fbab service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:52:40.221129 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-2f47a9f0-0e47-4574-ba44-63f98976e994 req-851582fd-2191-48d1-8018-03b96412fbab service nova] Creating event network-changed:17b1439f-4cc3-4d4c-b490-310c2cd9fa90 for instance 8defd782-54e9-4545-98ef-baab0163a1d5 on hv-cinder-84875 Jul 12 17:52:40.226354 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-2f47a9f0-0e47-4574-ba44-63f98976e994 req-851582fd-2191-48d1-8018-03b96412fbab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034600 Jul 12 17:52:40.226963 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 596/1203] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:52:59.012066 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 17:52:59.013059 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Tue Jul 12 17:52:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 17:54:20.559205 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 17:54:20.559851 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Tue Jul 12 17:54:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 17:54:35.410147 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:54:35.410883 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=56 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:54:35.414851 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-364c933c-2283-479b-b194-cfd81d86bc9c tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:54:35.415380 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-364c933c-2283-479b-b194-cfd81d86bc9c tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:54:35.422598 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-364c933c-2283-479b-b194-cfd81d86bc9c tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:35.427205 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-364c933c-2283-479b-b194-cfd81d86bc9c tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:35.427205 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-364c933c-2283-479b-b194-cfd81d86bc9c tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:35.427205 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-364c933c-2283-479b-b194-cfd81d86bc9c tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:35.448322 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.objects.instance [None req-364c933c-2283-479b-b194-cfd81d86bc9c tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lazy-loading 'flavor' on Instance uuid 8defd782-54e9-4545-98ef-baab0163a1d5 {{(pid=130059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:54:35.710253 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-364c933c-2283-479b-b194-cfd81d86bc9c tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "POST /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5/action" status: 202 len: 0 microversion: 2.1 time: 0.301726 Jul 12 17:54:35.710860 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 608/1204] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jul 12 17:54:35 2022] POST /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:54:35.718176 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_api:SELECT=22 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:54:35.718942 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=42 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:54:35.723377 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-66988957-862b-40f6-8735-ccb3b20acd7b tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:54:35.724070 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-66988957-862b-40f6-8735-ccb3b20acd7b tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:54:35.730087 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-66988957-862b-40f6-8735-ccb3b20acd7b tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:35.731400 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-66988957-862b-40f6-8735-ccb3b20acd7b tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:35.731400 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-66988957-862b-40f6-8735-ccb3b20acd7b tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:35.731803 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-66988957-862b-40f6-8735-ccb3b20acd7b tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:35.913471 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-66988957-862b-40f6-8735-ccb3b20acd7b tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:54:35.921462 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-66988957-862b-40f6-8735-ccb3b20acd7b tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1570 microversion: 2.1 time: 0.205284 Jul 12 17:54:35.922022 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 597/1205] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:54:35 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1570 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:54:36.940587 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-a2298c1d-610e-449f-a4e0-4f05e3d419a4 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:54:36.941181 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-a2298c1d-610e-449f-a4e0-4f05e3d419a4 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:54:36.947327 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a2298c1d-610e-449f-a4e0-4f05e3d419a4 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:36.948460 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a2298c1d-610e-449f-a4e0-4f05e3d419a4 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:36.949404 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a2298c1d-610e-449f-a4e0-4f05e3d419a4 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:36.949840 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-a2298c1d-610e-449f-a4e0-4f05e3d419a4 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:37.129595 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-a2298c1d-610e-449f-a4e0-4f05e3d419a4 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:54:37.137039 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-a2298c1d-610e-449f-a4e0-4f05e3d419a4 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1570 microversion: 2.1 time: 0.201270 Jul 12 17:54:37.137594 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 609/1206] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:54:36 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1570 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:54:38.153832 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-24e8bb1c-2211-4a11-a54e-72f502371962 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:54:38.154555 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-24e8bb1c-2211-4a11-a54e-72f502371962 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:54:38.160956 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-24e8bb1c-2211-4a11-a54e-72f502371962 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:38.161408 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-24e8bb1c-2211-4a11-a54e-72f502371962 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:38.162166 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-24e8bb1c-2211-4a11-a54e-72f502371962 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:38.162637 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-24e8bb1c-2211-4a11-a54e-72f502371962 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:38.288907 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-24e8bb1c-2211-4a11-a54e-72f502371962 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:54:38.296413 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-24e8bb1c-2211-4a11-a54e-72f502371962 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1570 microversion: 2.1 time: 0.146423 Jul 12 17:54:38.296970 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 598/1207] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:54:38 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:54:39.313576 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-9292b998-bb5a-438d-aae7-e4195a7b5328 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:54:39.314157 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-9292b998-bb5a-438d-aae7-e4195a7b5328 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:54:39.320574 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9292b998-bb5a-438d-aae7-e4195a7b5328 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:39.321022 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9292b998-bb5a-438d-aae7-e4195a7b5328 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:39.321789 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9292b998-bb5a-438d-aae7-e4195a7b5328 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:39.322228 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-9292b998-bb5a-438d-aae7-e4195a7b5328 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:39.454876 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-9292b998-bb5a-438d-aae7-e4195a7b5328 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:54:39.462283 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-9292b998-bb5a-438d-aae7-e4195a7b5328 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1570 microversion: 2.1 time: 0.152663 Jul 12 17:54:39.462887 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 610/1208] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:54:39 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:54:40.480633 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-03259308-fe8e-4cfc-801c-e925a63a49e5 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:54:40.481237 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-03259308-fe8e-4cfc-801c-e925a63a49e5 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:54:40.487851 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-03259308-fe8e-4cfc-801c-e925a63a49e5 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:40.488301 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-03259308-fe8e-4cfc-801c-e925a63a49e5 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:40.489063 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-03259308-fe8e-4cfc-801c-e925a63a49e5 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:40.489502 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-03259308-fe8e-4cfc-801c-e925a63a49e5 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:40.623426 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-03259308-fe8e-4cfc-801c-e925a63a49e5 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:54:40.630821 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-03259308-fe8e-4cfc-801c-e925a63a49e5 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1570 microversion: 2.1 time: 0.154782 Jul 12 17:54:40.631382 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 599/1209] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:54:40 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:54:41.647592 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-8a6b01cc-17ca-4f33-92ee-17693be5d950 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:54:41.650339 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-8a6b01cc-17ca-4f33-92ee-17693be5d950 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:54:41.654769 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8a6b01cc-17ca-4f33-92ee-17693be5d950 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:41.655210 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8a6b01cc-17ca-4f33-92ee-17693be5d950 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:41.655958 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8a6b01cc-17ca-4f33-92ee-17693be5d950 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:41.656388 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-8a6b01cc-17ca-4f33-92ee-17693be5d950 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:41.786151 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-8a6b01cc-17ca-4f33-92ee-17693be5d950 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:54:41.794161 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-8a6b01cc-17ca-4f33-92ee-17693be5d950 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1570 microversion: 2.1 time: 0.150429 Jul 12 17:54:41.794765 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 611/1210] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:54:41 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:54:42.810805 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b18bf970-70c1-446b-a84b-7d3effcbb11a tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:54:42.811403 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-b18bf970-70c1-446b-a84b-7d3effcbb11a tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:54:42.817809 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b18bf970-70c1-446b-a84b-7d3effcbb11a tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:42.818248 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b18bf970-70c1-446b-a84b-7d3effcbb11a tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:42.819064 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b18bf970-70c1-446b-a84b-7d3effcbb11a tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:42.819530 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b18bf970-70c1-446b-a84b-7d3effcbb11a tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:42.950809 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-b18bf970-70c1-446b-a84b-7d3effcbb11a tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:54:42.958263 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-b18bf970-70c1-446b-a84b-7d3effcbb11a tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1570 microversion: 2.1 time: 0.151685 Jul 12 17:54:42.958851 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 600/1211] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:54:42 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:54:43.976169 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-417e2de4-973e-480d-915a-35d88a4764db tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:54:43.976783 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-417e2de4-973e-480d-915a-35d88a4764db tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:54:43.983281 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-417e2de4-973e-480d-915a-35d88a4764db tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:43.983724 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-417e2de4-973e-480d-915a-35d88a4764db tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:43.984829 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-417e2de4-973e-480d-915a-35d88a4764db tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:43.984944 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-417e2de4-973e-480d-915a-35d88a4764db tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:44.114116 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-417e2de4-973e-480d-915a-35d88a4764db tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:54:44.122095 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-417e2de4-973e-480d-915a-35d88a4764db tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1570 microversion: 2.1 time: 0.150202 Jul 12 17:54:44.122683 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 612/1212] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:54:43 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:54:45.139651 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-6763f6ad-4a4c-4742-9f91-dcbf456939c0 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:54:45.140244 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-6763f6ad-4a4c-4742-9f91-dcbf456939c0 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:54:45.146691 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6763f6ad-4a4c-4742-9f91-dcbf456939c0 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:45.147135 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6763f6ad-4a4c-4742-9f91-dcbf456939c0 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:45.147884 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6763f6ad-4a4c-4742-9f91-dcbf456939c0 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:45.148316 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-6763f6ad-4a4c-4742-9f91-dcbf456939c0 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:45.283238 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-6763f6ad-4a4c-4742-9f91-dcbf456939c0 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:54:45.290706 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-6763f6ad-4a4c-4742-9f91-dcbf456939c0 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1570 microversion: 2.1 time: 0.155641 Jul 12 17:54:45.291739 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 601/1213] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:54:45 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:54:46.308941 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-75eeef83-638f-4130-8d62-f6e5db4c5a60 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:54:46.309553 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-75eeef83-638f-4130-8d62-f6e5db4c5a60 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:54:46.316083 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-75eeef83-638f-4130-8d62-f6e5db4c5a60 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:46.316540 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-75eeef83-638f-4130-8d62-f6e5db4c5a60 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:46.317305 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-75eeef83-638f-4130-8d62-f6e5db4c5a60 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:46.317743 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-75eeef83-638f-4130-8d62-f6e5db4c5a60 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:46.450807 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-75eeef83-638f-4130-8d62-f6e5db4c5a60 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:54:46.458517 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-75eeef83-638f-4130-8d62-f6e5db4c5a60 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1570 microversion: 2.1 time: 0.154417 Jul 12 17:54:46.459093 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 613/1214] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:54:46 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:54:47.477403 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-3f5bd731-a95d-4232-af3e-2a3370a1eb69 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:54:47.478012 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-3f5bd731-a95d-4232-af3e-2a3370a1eb69 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:54:47.485200 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3f5bd731-a95d-4232-af3e-2a3370a1eb69 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:47.485644 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3f5bd731-a95d-4232-af3e-2a3370a1eb69 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:47.486396 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3f5bd731-a95d-4232-af3e-2a3370a1eb69 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:47.486855 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-3f5bd731-a95d-4232-af3e-2a3370a1eb69 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:47.620344 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-3f5bd731-a95d-4232-af3e-2a3370a1eb69 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:54:47.627871 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-3f5bd731-a95d-4232-af3e-2a3370a1eb69 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1570 microversion: 2.1 time: 0.154342 Jul 12 17:54:47.628430 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 602/1215] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:54:47 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:54:48.645067 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-832edb38-cdf4-4d17-91eb-576fabe7afbe tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:54:48.645685 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-832edb38-cdf4-4d17-91eb-576fabe7afbe tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:54:48.653149 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-832edb38-cdf4-4d17-91eb-576fabe7afbe tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:48.653604 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-832edb38-cdf4-4d17-91eb-576fabe7afbe tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:48.654469 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-832edb38-cdf4-4d17-91eb-576fabe7afbe tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:48.654899 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-832edb38-cdf4-4d17-91eb-576fabe7afbe tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:48.792143 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-832edb38-cdf4-4d17-91eb-576fabe7afbe tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:54:48.799831 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-832edb38-cdf4-4d17-91eb-576fabe7afbe tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1570 microversion: 2.1 time: 0.158705 Jul 12 17:54:48.809656 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 614/1216] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:54:48 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:54:49.817018 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-7381da2b-d821-465c-8c0a-ecc49cf534fb tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:54:49.817621 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-7381da2b-d821-465c-8c0a-ecc49cf534fb tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:54:49.824642 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7381da2b-d821-465c-8c0a-ecc49cf534fb tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:49.825872 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7381da2b-d821-465c-8c0a-ecc49cf534fb tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:49.825872 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7381da2b-d821-465c-8c0a-ecc49cf534fb tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:49.826366 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-7381da2b-d821-465c-8c0a-ecc49cf534fb tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:49.957483 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-7381da2b-d821-465c-8c0a-ecc49cf534fb tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:54:49.965665 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-7381da2b-d821-465c-8c0a-ecc49cf534fb tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1511 microversion: 2.1 time: 0.152529 Jul 12 17:54:49.966230 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 603/1217] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:54:49 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:54:49.981591 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-f6837938-4a9f-4450-8883-83136fbdfe12 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:54:49.982202 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-f6837938-4a9f-4450-8883-83136fbdfe12 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:54:49.988708 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f6837938-4a9f-4450-8883-83136fbdfe12 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:49.989199 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f6837938-4a9f-4450-8883-83136fbdfe12 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:49.989968 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f6837938-4a9f-4450-8883-83136fbdfe12 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:49.990410 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-f6837938-4a9f-4450-8883-83136fbdfe12 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:50.208287 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-f6837938-4a9f-4450-8883-83136fbdfe12 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "POST /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5/action" status: 202 len: 0 microversion: 2.1 time: 0.230521 Jul 12 17:54:50.208818 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 615/1218] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jul 12 17:54:49 2022] POST /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:54:50.217676 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-b08d66fd-0959-4072-8a0f-9628c993f82a tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:54:50.218367 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-b08d66fd-0959-4072-8a0f-9628c993f82a tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:54:50.224255 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b08d66fd-0959-4072-8a0f-9628c993f82a tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:50.224702 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b08d66fd-0959-4072-8a0f-9628c993f82a tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:50.225458 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b08d66fd-0959-4072-8a0f-9628c993f82a tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:50.225887 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-b08d66fd-0959-4072-8a0f-9628c993f82a tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:50.395603 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-b08d66fd-0959-4072-8a0f-9628c993f82a tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:54:50.403917 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-b08d66fd-0959-4072-8a0f-9628c993f82a tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1519 microversion: 2.1 time: 0.190810 Jul 12 17:54:50.404497 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 604/1219] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:54:50 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1519 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:54:51.421394 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-0cceee65-5387-4e96-85f7-468c55b0c7cd tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:54:51.422026 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-0cceee65-5387-4e96-85f7-468c55b0c7cd tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:54:51.427951 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0cceee65-5387-4e96-85f7-468c55b0c7cd tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:51.428471 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0cceee65-5387-4e96-85f7-468c55b0c7cd tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:51.429261 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0cceee65-5387-4e96-85f7-468c55b0c7cd tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:51.429695 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-0cceee65-5387-4e96-85f7-468c55b0c7cd tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:51.563701 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-0cceee65-5387-4e96-85f7-468c55b0c7cd tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:54:51.571210 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-0cceee65-5387-4e96-85f7-468c55b0c7cd tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1521 microversion: 2.1 time: 0.154063 Jul 12 17:54:51.571772 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 616/1220] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:54:51 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:54:52.289437 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-361cd67a-6e73-404f-b808-cdb2037ea75b req-f7a110e2-36de-4f16-82b4-76de3eb65628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8defd782-54e9-4545-98ef-baab0163a1d5", "name": "network-vif-unplugged", "status": "completed", "tag": "17b1439f-4cc3-4d4c-b490-310c2cd9fa90"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:54:52.300456 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-361cd67a-6e73-404f-b808-cdb2037ea75b req-f7a110e2-36de-4f16-82b4-76de3eb65628 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:52.300925 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-361cd67a-6e73-404f-b808-cdb2037ea75b req-f7a110e2-36de-4f16-82b4-76de3eb65628 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:52.312860 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.compute.server_external_events [req-361cd67a-6e73-404f-b808-cdb2037ea75b req-f7a110e2-36de-4f16-82b4-76de3eb65628 service nova] Unable to find a host for instance 8defd782-54e9-4545-98ef-baab0163a1d5. Dropping event network-vif-unplugged {{(pid=130058) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 12 17:54:52.313755 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-361cd67a-6e73-404f-b808-cdb2037ea75b req-f7a110e2-36de-4f16-82b4-76de3eb65628 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028239 Jul 12 17:54:52.317258 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 605/1221] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 12 17:54:52.589430 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-462b18b4-cbc7-4bc6-841f-0d16f4a88ae7 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:54:52.590043 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-462b18b4-cbc7-4bc6-841f-0d16f4a88ae7 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:54:52.596294 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-462b18b4-cbc7-4bc6-841f-0d16f4a88ae7 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:52.596745 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-462b18b4-cbc7-4bc6-841f-0d16f4a88ae7 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:52.597555 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-462b18b4-cbc7-4bc6-841f-0d16f4a88ae7 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:52.598000 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-462b18b4-cbc7-4bc6-841f-0d16f4a88ae7 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:52.727301 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-462b18b4-cbc7-4bc6-841f-0d16f4a88ae7 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:54:52.735391 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-462b18b4-cbc7-4bc6-841f-0d16f4a88ae7 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1577 microversion: 2.1 time: 0.150526 Jul 12 17:54:52.735949 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 617/1222] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:54:52 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:54:53.752653 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-f428b15a-52de-41fd-84ce-a0c2a46c643b tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:54:53.753365 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-f428b15a-52de-41fd-84ce-a0c2a46c643b tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:54:53.759765 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f428b15a-52de-41fd-84ce-a0c2a46c643b tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:53.760701 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f428b15a-52de-41fd-84ce-a0c2a46c643b tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:53.761451 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f428b15a-52de-41fd-84ce-a0c2a46c643b tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:53.761879 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-f428b15a-52de-41fd-84ce-a0c2a46c643b tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:53.893012 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-f428b15a-52de-41fd-84ce-a0c2a46c643b tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:54:53.900799 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-f428b15a-52de-41fd-84ce-a0c2a46c643b tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1577 microversion: 2.1 time: 0.151827 Jul 12 17:54:53.901383 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 606/1223] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:54:53 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:54:54.918670 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-430cecbf-d726-465d-96e2-b6dbfc64c432 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:54:54.919257 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-430cecbf-d726-465d-96e2-b6dbfc64c432 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:54:54.925636 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-430cecbf-d726-465d-96e2-b6dbfc64c432 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:54.926087 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-430cecbf-d726-465d-96e2-b6dbfc64c432 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:54.926887 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-430cecbf-d726-465d-96e2-b6dbfc64c432 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:54.927328 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-430cecbf-d726-465d-96e2-b6dbfc64c432 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:55.060534 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-430cecbf-d726-465d-96e2-b6dbfc64c432 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:54:55.068018 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-430cecbf-d726-465d-96e2-b6dbfc64c432 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1577 microversion: 2.1 time: 0.153941 Jul 12 17:54:55.068582 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 618/1224] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:54:54 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:54:56.085552 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-49177ca1-58c9-4347-8795-c352ec570990 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:54:56.086208 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-49177ca1-58c9-4347-8795-c352ec570990 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:54:56.093323 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-49177ca1-58c9-4347-8795-c352ec570990 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:56.093778 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-49177ca1-58c9-4347-8795-c352ec570990 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:56.094567 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-49177ca1-58c9-4347-8795-c352ec570990 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:56.095011 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-49177ca1-58c9-4347-8795-c352ec570990 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:56.225037 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-49177ca1-58c9-4347-8795-c352ec570990 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:54:56.233234 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-49177ca1-58c9-4347-8795-c352ec570990 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1577 microversion: 2.1 time: 0.151778 Jul 12 17:54:56.233803 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 607/1225] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:54:56 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:54:57.249568 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-82961fdc-4387-4d0c-a0ec-bb9b1e2c81dc tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:54:57.250119 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-82961fdc-4387-4d0c-a0ec-bb9b1e2c81dc tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:54:57.256699 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-82961fdc-4387-4d0c-a0ec-bb9b1e2c81dc tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:57.257154 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-82961fdc-4387-4d0c-a0ec-bb9b1e2c81dc tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:57.257928 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-82961fdc-4387-4d0c-a0ec-bb9b1e2c81dc tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:57.258369 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-82961fdc-4387-4d0c-a0ec-bb9b1e2c81dc tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:57.385663 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-82961fdc-4387-4d0c-a0ec-bb9b1e2c81dc tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:54:57.393079 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-82961fdc-4387-4d0c-a0ec-bb9b1e2c81dc tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1577 microversion: 2.1 time: 0.147462 Jul 12 17:54:57.393669 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 619/1226] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:54:57 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1577 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:54:58.411019 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-0ef7ea03-b034-40f2-b6a8-544fa660979e tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:54:58.411691 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-0ef7ea03-b034-40f2-b6a8-544fa660979e tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:54:58.419095 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ef7ea03-b034-40f2-b6a8-544fa660979e tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:58.419552 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ef7ea03-b034-40f2-b6a8-544fa660979e tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:58.420322 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ef7ea03-b034-40f2-b6a8-544fa660979e tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:58.420763 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-0ef7ea03-b034-40f2-b6a8-544fa660979e tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:58.553241 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-0ef7ea03-b034-40f2-b6a8-544fa660979e tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:54:58.557540 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-0ef7ea03-b034-40f2-b6a8-544fa660979e tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1577 microversion: 2.1 time: 0.149881 Jul 12 17:54:58.558157 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 608/1227] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:54:58 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:54:59.575382 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-2c98bf7a-8803-4111-a42a-79ccdc72c3ad tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:54:59.575972 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-2c98bf7a-8803-4111-a42a-79ccdc72c3ad tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:54:59.582366 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2c98bf7a-8803-4111-a42a-79ccdc72c3ad tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:59.582843 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2c98bf7a-8803-4111-a42a-79ccdc72c3ad tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:59.583604 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2c98bf7a-8803-4111-a42a-79ccdc72c3ad tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:54:59.584065 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-2c98bf7a-8803-4111-a42a-79ccdc72c3ad tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:54:59.717563 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-2c98bf7a-8803-4111-a42a-79ccdc72c3ad tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:54:59.725061 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-2c98bf7a-8803-4111-a42a-79ccdc72c3ad tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1577 microversion: 2.1 time: 0.154254 Jul 12 17:54:59.725625 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 620/1228] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:54:59 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:55:00.741977 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-243644df-332f-45c0-aa98-fa213f47e640 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:55:00.742627 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-243644df-332f-45c0-aa98-fa213f47e640 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:55:00.749796 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-243644df-332f-45c0-aa98-fa213f47e640 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:55:00.751530 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-243644df-332f-45c0-aa98-fa213f47e640 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:55:00.751530 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-243644df-332f-45c0-aa98-fa213f47e640 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:55:00.751530 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-243644df-332f-45c0-aa98-fa213f47e640 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:55:00.883319 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-243644df-332f-45c0-aa98-fa213f47e640 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:55:00.891644 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-243644df-332f-45c0-aa98-fa213f47e640 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1577 microversion: 2.1 time: 0.153628 Jul 12 17:55:00.892206 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 609/1229] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:55:00 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:55:01.908746 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-3ce4f242-f211-4f2d-b7fc-c15f7b31c6d5 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:55:01.909276 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-3ce4f242-f211-4f2d-b7fc-c15f7b31c6d5 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:55:01.916521 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3ce4f242-f211-4f2d-b7fc-c15f7b31c6d5 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:55:01.916994 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3ce4f242-f211-4f2d-b7fc-c15f7b31c6d5 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:55:01.917764 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3ce4f242-f211-4f2d-b7fc-c15f7b31c6d5 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:55:01.918205 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-3ce4f242-f211-4f2d-b7fc-c15f7b31c6d5 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:55:01.938649 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:55:02.048605 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-3ce4f242-f211-4f2d-b7fc-c15f7b31c6d5 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:55:02.056474 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-3ce4f242-f211-4f2d-b7fc-c15f7b31c6d5 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1577 microversion: 2.1 time: 0.151727 Jul 12 17:55:02.057996 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 621/1230] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:55:01 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:55:03.075429 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-e82d7633-278d-411c-9c73-a3fe64db6dc4 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:55:03.076051 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-e82d7633-278d-411c-9c73-a3fe64db6dc4 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:55:03.082573 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e82d7633-278d-411c-9c73-a3fe64db6dc4 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:55:03.083029 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e82d7633-278d-411c-9c73-a3fe64db6dc4 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:55:03.083796 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e82d7633-278d-411c-9c73-a3fe64db6dc4 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:55:03.084234 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-e82d7633-278d-411c-9c73-a3fe64db6dc4 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:55:03.216358 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-e82d7633-278d-411c-9c73-a3fe64db6dc4 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:55:03.223908 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-e82d7633-278d-411c-9c73-a3fe64db6dc4 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1577 microversion: 2.1 time: 0.153061 Jul 12 17:55:03.225270 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 610/1231] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:55:03 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:55:04.241164 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-5e082f63-8c70-45c1-b8d8-b83538f26ece tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:55:04.241783 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-5e082f63-8c70-45c1-b8d8-b83538f26ece tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:55:04.248398 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5e082f63-8c70-45c1-b8d8-b83538f26ece tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:55:04.248853 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5e082f63-8c70-45c1-b8d8-b83538f26ece tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:55:04.249630 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5e082f63-8c70-45c1-b8d8-b83538f26ece tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:55:04.250080 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-5e082f63-8c70-45c1-b8d8-b83538f26ece tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:55:04.372786 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-4706e90c-cddf-4998-b3d5-65842ee2e83e req-c359ebe0-eb22-4514-8553-2cba9483d802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8defd782-54e9-4545-98ef-baab0163a1d5", "name": "network-vif-plugged", "status": "completed", "tag": "17b1439f-4cc3-4d4c-b490-310c2cd9fa90"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:55:04.381248 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-4706e90c-cddf-4998-b3d5-65842ee2e83e req-c359ebe0-eb22-4514-8553-2cba9483d802 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:55:04.381696 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-4706e90c-cddf-4998-b3d5-65842ee2e83e req-c359ebe0-eb22-4514-8553-2cba9483d802 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:55:04.383609 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-5e082f63-8c70-45c1-b8d8-b83538f26ece tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:55:04.392499 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-5e082f63-8c70-45c1-b8d8-b83538f26ece tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1577 microversion: 2.1 time: 0.155260 Jul 12 17:55:04.393079 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 622/1232] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:55:04 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:55:04.393945 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-4706e90c-cddf-4998-b3d5-65842ee2e83e req-c359ebe0-eb22-4514-8553-2cba9483d802 service nova] Creating event network-vif-plugged:17b1439f-4cc3-4d4c-b490-310c2cd9fa90 for instance 8defd782-54e9-4545-98ef-baab0163a1d5 on hv-cinder-84875 Jul 12 17:55:04.399145 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-4706e90c-cddf-4998-b3d5-65842ee2e83e req-c359ebe0-eb22-4514-8553-2cba9483d802 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031005 Jul 12 17:55:04.399791 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 611/1233] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:55:05.409252 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-fe0b4a4c-7456-4dc5-824e-330424f556af tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:55:05.409869 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-fe0b4a4c-7456-4dc5-824e-330424f556af tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:55:05.416964 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fe0b4a4c-7456-4dc5-824e-330424f556af tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:55:05.417414 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fe0b4a4c-7456-4dc5-824e-330424f556af tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:55:05.418171 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fe0b4a4c-7456-4dc5-824e-330424f556af tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:55:05.418705 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-fe0b4a4c-7456-4dc5-824e-330424f556af tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:55:05.549761 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-fe0b4a4c-7456-4dc5-824e-330424f556af tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:55:05.557647 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-fe0b4a4c-7456-4dc5-824e-330424f556af tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1577 microversion: 2.1 time: 0.152219 Jul 12 17:55:05.558211 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 623/1234] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:55:05 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:55:06.575723 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-946059f1-5904-4407-a3b6-75397e90f4a9 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:55:06.576424 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-946059f1-5904-4407-a3b6-75397e90f4a9 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:55:06.578742 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_api:SELECT=31 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:55:06.583343 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-946059f1-5904-4407-a3b6-75397e90f4a9 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:55:06.583799 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-946059f1-5904-4407-a3b6-75397e90f4a9 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:55:06.584568 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-946059f1-5904-4407-a3b6-75397e90f4a9 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:55:06.585011 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-946059f1-5904-4407-a3b6-75397e90f4a9 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:55:06.589521 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=83 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:55:06.969053 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-946059f1-5904-4407-a3b6-75397e90f4a9 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:55:06.976414 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-946059f1-5904-4407-a3b6-75397e90f4a9 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1564 microversion: 2.1 time: 0.405743 Jul 12 17:55:06.976985 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 612/1235] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:55:06 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1564 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:55:59.278873 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 17:55:59.279413 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Tue Jul 12 17:55:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 17:55:59.439692 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 17:55:59.440220 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Tue Jul 12 17:55:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 17:56:23.717488 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_api:SELECT=34 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:56:23.719139 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_api:SELECT=1 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:56:23.719605 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG dbcounter [-] [130059] Writing DB stats nova_cell1:SELECT=14 {{(pid=130059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:56:23.719945 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG dbcounter [-] [130058] Writing DB stats nova_cell1:SELECT=5 {{(pid=130058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:56:23.723301 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-eb398215-000b-4fa0-96f8-48b5fe99a8c9 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:56:23.723800 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-eb398215-000b-4fa0-96f8-48b5fe99a8c9 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:56:23.729889 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-eb398215-000b-4fa0-96f8-48b5fe99a8c9 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:56:23.733827 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-eb398215-000b-4fa0-96f8-48b5fe99a8c9 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:56:23.733827 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-eb398215-000b-4fa0-96f8-48b5fe99a8c9 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:56:23.733827 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-eb398215-000b-4fa0-96f8-48b5fe99a8c9 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:56:23.760106 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-eb398215-000b-4fa0-96f8-48b5fe99a8c9 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Going to try to terminate instance {{(pid=130059) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:56:23.781677 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-8d91a212-8331-4eeb-b459-889b8a3429ba req-5e98944a-1147-4449-a2cc-48b9469ff878 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8defd782-54e9-4545-98ef-baab0163a1d5", "tag": "17b1439f-4cc3-4d4c-b490-310c2cd9fa90"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:56:23.789882 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-8d91a212-8331-4eeb-b459-889b8a3429ba req-5e98944a-1147-4449-a2cc-48b9469ff878 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:56:23.790326 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-8d91a212-8331-4eeb-b459-889b8a3429ba req-5e98944a-1147-4449-a2cc-48b9469ff878 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:56:23.801936 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-8d91a212-8331-4eeb-b459-889b8a3429ba req-5e98944a-1147-4449-a2cc-48b9469ff878 service nova] Creating event network-changed:17b1439f-4cc3-4d4c-b490-310c2cd9fa90 for instance 8defd782-54e9-4545-98ef-baab0163a1d5 on hv-cinder-84875 Jul 12 17:56:23.808049 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-8d91a212-8331-4eeb-b459-889b8a3429ba req-5e98944a-1147-4449-a2cc-48b9469ff878 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090466 Jul 12 17:56:23.811369 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 613/1236] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:56:24.055696 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-eb398215-000b-4fa0-96f8-48b5fe99a8c9 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 204 len: 0 microversion: 2.1 time: 0.339874 Jul 12 17:56:24.056619 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 624/1237] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 12 17:56:23 2022] DELETE /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:56:24.066297 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-dc50639f-e3b1-4332-a176-b4fb8f5a12bf tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:56:24.067027 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-dc50639f-e3b1-4332-a176-b4fb8f5a12bf tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:56:24.073300 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-dc50639f-e3b1-4332-a176-b4fb8f5a12bf tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:56:24.073748 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-dc50639f-e3b1-4332-a176-b4fb8f5a12bf tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:56:24.075192 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-dc50639f-e3b1-4332-a176-b4fb8f5a12bf tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:56:24.075653 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-dc50639f-e3b1-4332-a176-b4fb8f5a12bf tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:56:24.210090 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-dc50639f-e3b1-4332-a176-b4fb8f5a12bf tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:56:24.217621 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-dc50639f-e3b1-4332-a176-b4fb8f5a12bf tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1570 microversion: 2.1 time: 0.156339 Jul 12 17:56:24.218184 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 614/1238] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:56:24 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:56:25.236809 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-694a7fa9-f4d9-4bfa-9404-4beaf600444f tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:56:25.237519 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-694a7fa9-f4d9-4bfa-9404-4beaf600444f tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:56:25.244188 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-694a7fa9-f4d9-4bfa-9404-4beaf600444f tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:56:25.244645 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-694a7fa9-f4d9-4bfa-9404-4beaf600444f tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:56:25.245443 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-694a7fa9-f4d9-4bfa-9404-4beaf600444f tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:56:25.245887 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-694a7fa9-f4d9-4bfa-9404-4beaf600444f tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:56:25.384060 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-694a7fa9-f4d9-4bfa-9404-4beaf600444f tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:56:25.391802 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-694a7fa9-f4d9-4bfa-9404-4beaf600444f tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1570 microversion: 2.1 time: 0.159308 Jul 12 17:56:25.392365 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 625/1239] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:56:25 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:56:26.219431 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [req-50a3abfb-6bd0-4075-9b72-5c66eff9d757 req-9300488a-1407-483e-8af0-0a5e1ffe3a87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8defd782-54e9-4545-98ef-baab0163a1d5", "name": "network-vif-deleted", "tag": "17b1439f-4cc3-4d4c-b490-310c2cd9fa90"}]} {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:56:26.228933 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-50a3abfb-6bd0-4075-9b72-5c66eff9d757 req-9300488a-1407-483e-8af0-0a5e1ffe3a87 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:56:26.235866 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [req-50a3abfb-6bd0-4075-9b72-5c66eff9d757 req-9300488a-1407-483e-8af0-0a5e1ffe3a87 service nova] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:56:26.241281 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.compute.server_external_events [req-50a3abfb-6bd0-4075-9b72-5c66eff9d757 req-9300488a-1407-483e-8af0-0a5e1ffe3a87 service nova] Creating event network-vif-deleted:17b1439f-4cc3-4d4c-b490-310c2cd9fa90 for instance 8defd782-54e9-4545-98ef-baab0163a1d5 on hv-cinder-84875 Jul 12 17:56:26.246261 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [req-50a3abfb-6bd0-4075-9b72-5c66eff9d757 req-9300488a-1407-483e-8af0-0a5e1ffe3a87 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031035 Jul 12 17:56:26.246988 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 615/1240] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 12 17:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:56:26.409351 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-44cc22e3-b248-49ed-bfe2-27be575893c2 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:56:26.409960 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-44cc22e3-b248-49ed-bfe2-27be575893c2 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:56:26.417044 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-44cc22e3-b248-49ed-bfe2-27be575893c2 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:56:26.417504 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-44cc22e3-b248-49ed-bfe2-27be575893c2 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:56:26.418496 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-44cc22e3-b248-49ed-bfe2-27be575893c2 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:56:26.418978 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-44cc22e3-b248-49ed-bfe2-27be575893c2 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:56:26.485175 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.policy [None req-44cc22e3-b248-49ed-bfe2-27be575893c2 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:56:26.493059 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-44cc22e3-b248-49ed-bfe2-27be575893c2 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1220 microversion: 2.1 time: 0.087532 Jul 12 17:56:26.493637 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 626/1241] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:56:26 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:56:27.510529 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-ed6d67c5-3e09-428a-b85c-335e1e889100 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:56:27.511235 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.compute.api [None req-ed6d67c5-3e09-428a-b85c-335e1e889100 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130058) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:56:27.518234 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ed6d67c5-3e09-428a-b85c-335e1e889100 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:56:27.518746 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ed6d67c5-3e09-428a-b85c-335e1e889100 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:56:27.519536 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ed6d67c5-3e09-428a-b85c-335e1e889100 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:56:27.519977 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ed6d67c5-3e09-428a-b85c-335e1e889100 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:56:27.551370 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ed6d67c5-3e09-428a-b85c-335e1e889100 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:56:27.551818 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG oslo_concurrency.lockutils [None req-ed6d67c5-3e09-428a-b85c-335e1e889100 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:56:27.552258 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.objects.instance [None req-ed6d67c5-3e09-428a-b85c-335e1e889100 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lazy-loading 'fault' on Instance uuid 8defd782-54e9-4545-98ef-baab0163a1d5 {{(pid=130058) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:56:27.596458 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.policy [None req-ed6d67c5-3e09-428a-b85c-335e1e889100 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7ac2d6a1f4449595c380e164c96248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0af5b7947c74fb5879d0e9bf9ba3860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130058) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:56:27.603934 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-ed6d67c5-3e09-428a-b85c-335e1e889100 tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 200 len: 1225 microversion: 2.1 time: 0.098319 Jul 12 17:56:27.604499 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 616/1242] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:56:27 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:56:28.623610 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-bbb5b15e-c104-448b-8a71-b0ad48d70ffa tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '>' {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:56:28.624223 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.compute.api [None req-bbb5b15e-c104-448b-8a71-b0ad48d70ffa tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] [instance: 8defd782-54e9-4545-98ef-baab0163a1d5] Fetching instance by UUID {{(pid=130059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:56:28.630711 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bbb5b15e-c104-448b-8a71-b0ad48d70ffa tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:56:28.631161 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bbb5b15e-c104-448b-8a71-b0ad48d70ffa tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:56:28.631928 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bbb5b15e-c104-448b-8a71-b0ad48d70ffa tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:56:28.632363 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG oslo_concurrency.lockutils [None req-bbb5b15e-c104-448b-8a71-b0ad48d70ffa tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Lock "3edbf35d-1b15-4b4d-a347-1a17c7474c01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:56:28.647991 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.wsgi [None req-bbb5b15e-c104-448b-8a71-b0ad48d70ffa tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] HTTP exception thrown: Instance 8defd782-54e9-4545-98ef-baab0163a1d5 could not be found. Jul 12 17:56:28.649644 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-bbb5b15e-c104-448b-8a71-b0ad48d70ffa tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Request method failure captured: Jul 12 17:56:28.649644 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: request: GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 HTTP/1.1 Jul 12 17:56:28.649644 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept: application/json Jul 12 17:56:28.649644 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Accept-Encoding: identity Jul 12 17:56:28.649644 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Connection: close Jul 12 17:56:28.649644 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Length: 0 Jul 12 17:56:28.649644 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Content-Type: application/json Jul 12 17:56:28.649644 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Host: 10.222.0.16 Jul 12 17:56:28.649644 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Openstack-System-Scope: None Jul 12 17:56:28.649644 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: User-Agent: python-urllib3/1.26.9 Jul 12 17:56:28.649644 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Auth-Token: gAAAAABizbS7ItjTTainLFXOGVvF1T_LRlQMCCgJgK5LSdc9h4JdMXsgTpt0qbL4HVeg-Y_hc94VlfSpzdSsxXVrpIm8igsbWuGTeuyKg7NrUZHuodIZuLd1LuuTxiU2A9KWgLGT97EXXRWSHDJxxzy5Igdr7h0M06-RYMXXjJBn3tlZ3V6cPWg Jul 12 17:56:28.649644 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Id: None Jul 12 17:56:28.649644 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Domain-Name: None Jul 12 17:56:28.649644 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Identity-Status: Confirmed Jul 12 17:56:28.649644 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Is-Admin-Project: True Jul 12 17:56:28.649644 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Id: default Jul 12 17:56:28.649644 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Domain-Name: Default Jul 12 17:56:28.649644 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Id: f0af5b7947c74fb5879d0e9bf9ba3860 Jul 12 17:56:28.649644 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Project-Name: tempest-TestShelveInstance-172474434 Jul 12 17:56:28.649644 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Role: reader,member Jul 12 17:56:28.649644 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Roles: reader,member Jul 12 17:56:28.651612 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f0af5b7947c74fb5879d0e9bf9ba3860"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f0af5b7947c74fb5879d0e9bf9ba3860", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f0af5b7947c74fb5879d0e9bf9ba3860"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f0af5b7947c74fb5879d0e9bf9ba3860"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}] Jul 12 17:56:28.651612 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant: tempest-TestShelveInstance-172474434 Jul 12 17:56:28.651612 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Id: f0af5b7947c74fb5879d0e9bf9ba3860 Jul 12 17:56:28.651612 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-Tenant-Name: tempest-TestShelveInstance-172474434 Jul 12 17:56:28.651612 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User: tempest-TestShelveInstance-172474434-project Jul 12 17:56:28.651612 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Id: default Jul 12 17:56:28.651612 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Domain-Name: Default Jul 12 17:56:28.651612 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Id: bb7ac2d6a1f4449595c380e164c96248 Jul 12 17:56:28.651612 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: X-User-Name: tempest-TestShelveInstance-172474434-project Jul 12 17:56:28.651612 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: method: > Jul 12 17:56:28.651612 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: exception: Instance 8defd782-54e9-4545-98ef-baab0163a1d5 could not be found. Jul 12 17:56:28.651612 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: action_args: {'id': '8defd782-54e9-4545-98ef-baab0163a1d5'} Jul 12 17:56:28.652667 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: {{(pid=130059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:56:28.652667 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:56:28.652667 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:56:28.652667 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:56:28.652667 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:56:28.652667 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:56:28.652667 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:56:28.652667 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:56:28.652667 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:56:28.652667 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:56:28.652667 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8defd782-54e9-4545-98ef-baab0163a1d5 could not be found. Jul 12 17:56:28.652667 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:56:28.652667 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:56:28.652667 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:56:28.652667 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:56:28.652667 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:56:28.652667 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:56:28.652667 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:56:28.652667 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:56:28.652667 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:56:28.654174 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:56:28.654174 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:56:28.654174 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:56:28.654174 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:56:28.654174 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:56:28.654174 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:56:28.654174 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:56:28.654174 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8defd782-54e9-4545-98ef-baab0163a1d5 could not be found. Jul 12 17:56:28.654174 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:56:28.654174 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:56:28.654174 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:56:28.654174 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:56:28.654174 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:56:28.654174 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:56:28.654174 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:56:28.654174 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:56:28.654174 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8defd782-54e9-4545-98ef-baab0163a1d5 could not be found. Jul 12 17:56:28.654174 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: ERROR nova.api.openstack.wsgi Jul 12 17:56:28.655535 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: DEBUG nova.api.openstack.wsgi [None req-bbb5b15e-c104-448b-8a71-b0ad48d70ffa tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Returning 404 to user: Instance 8defd782-54e9-4545-98ef-baab0163a1d5 could not be found. {{(pid=130059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:56:28.655535 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO nova.api.openstack.requestlog [None req-bbb5b15e-c104-448b-8a71-b0ad48d70ffa tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5" status: 404 len: 111 microversion: 2.1 time: 0.032010 Jul 12 17:56:28.655535 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: [pid: 130059|app: 0|req: 627/1243] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 12 17:56:28 2022] GET /compute/v2.1/servers/8defd782-54e9-4545-98ef-baab0163a1d5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:56:28.853942 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: DEBUG nova.api.openstack.wsgi [None req-ac6bbd61-f2fc-40d3-a5e5-c9c6a04815af tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] Calling method '.version_select at 0x7f479fe0f940>' {{(pid=130058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:56:28.935966 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO nova.api.openstack.requestlog [None req-ac6bbd61-f2fc-40d3-a5e5-c9c6a04815af tempest-TestShelveInstance-172474434 tempest-TestShelveInstance-172474434-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1273205958" status: 202 len: 0 microversion: 2.1 time: 0.085913 Jul 12 17:56:28.936546 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: [pid: 130058|app: 0|req: 617/1244] 10.222.0.16 () {58 vars in 1253 bytes} [Tue Jul 12 17:56:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1273205958 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:57:44.498554 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 17:57:44.499132 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Tue Jul 12 17:57:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 17:59:19.287094 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 17:59:19.287719 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Tue Jul 12 17:59:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 17:59:19.447801 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 17:59:19.448289 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Tue Jul 12 17:59:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 17:59:38.112656 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 17:59:38.113364 dv-cinder-848759-2-iscsi devstack@n-api.service[130058]: Tue Jul 12 17:59:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 17:59:39.024131 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 17:59:39.024637 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Tue Jul 12 17:59:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 18:01:04.507174 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 18:01:04.507901 dv-cinder-848759-2-iscsi devstack@n-api.service[130059]: Tue Jul 12 18:01:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!